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METHOD AND SYSTEM FOR ENHANCING 
FIBRE CHANNEL LOOP RESILIENCY FOR 

A MASS STORAGE ENCLOSURE BY 
INCREASING COMPONENT REDUNDANCY 
AND USING SHUNT ELEMENTS AND 
INTELLIGENT BYPASS MANAGEMENT 

TECHNICAL FIELD 

The present invention relates to multi-peripheral-device 
enclosures, and, in particular, to a method and system for 
increasing the reliability and availability of multi- 
peripheral -device enclosures by incorporating control ele- 
ments for isolating components. 

BACKGROUND OF THE INVENTION 

The fibre channel ("FC*) is an architecture and protocol 
for a data communication network for interconnecting a 
number of different combinations of computers and periph- 
eral devices. The FC supports a variety of upper-level 
protocols, including the small computer systems interface 
("SCSI") protocol. A computer or peripheral device is linked 
to the network through an FC port and copper wires or 
optical fibres. An FC port includes a transceiver and an 
interface controller, and the computer peripheral device in 
which the FC port is contained is called a "host/' The FC 
port exchanges data with the host via a local data bus, such 
as a peripheral computer interface ("PCI") bus. The interface 
controller conducts lower-level protocol exchanges between 
the fibre channel and the computer or peripheral device in 
which the FC port resides. 

Because of the high bandwidth and flexible connectivity 
provided by the FC, the FC is becoming a common medium 
for interconnecting peripheral devices within multi- 
peripheral-device enclosures, such as redundant arrays of 
inexpensive disks ("RAIDs"), and for connecting multi- 
peripheral-device enclosures with one or more host com- 
puters. These multi-pe rip her al-de vice enclosures economi- 
cally provide greatly increased storage capacities and built- 
in redundancy that facilitates mirroring and fail over 
strategies needed in high-availability systems. Although the 
FC is well-suited for this application with regard to capacity 
and connectivity, the FC is a serial communications 
medium. Malfunctioning peripheral devices and enclosures 
can, in certain cases, degrade or disable communications. A 
need has therefore been recognized for methods to improve 
the ability of FC-based multi-peripheral-device enclosures 
to isolate and recover from malfunctioning peripheral 
devices, and for improving the ability of systems including 
one or more host computers and multiple, interconnected 
FC-based multi-peripheral-device enclosures to isolate and 
recover from a malfunctioning multi-peripheral-device 
enclosure. A need has also been recognized for additional 
communications and component redundancies within multi- 
peripheral-device enclosures to facilitate higher levels of 
fault-tolerance and high-availability. 

SUMMARY OF THE INVENTION 

The present invention provides a method and system for 
isolating peripheral devices within a multi-peripheral-device 
enclosure from the communications medium used to inter- 
connect the peripheral devices within the multi-peripheral- 
device enclosure, and for isolating a multi-peripheral-device 
enclosure from a communications medium used to intercon- 
nect a number of multi-peripheral-device enclosures with a 
host computer. The present invention provides increased 
component redundancy within multi-peripheral-device 
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enclosures to eliminate single points of failure to increase 
fault-tolerance and high-availability of the multi-peripheral- 
device enclosures. 

Port bypass circuits are used to control access of periph- 

s eral devices to the communications medium used to inter- 
connect the peripheral devices within the multi-peripheral- 
device enclosure. The port bypass circuits are themselves 
controlled by port bypass circuit controllers that can, in turn, 
be controlled by software or firmware routines running on a 

10 microprocessor within the multi-peripheral-device enclo- 
sure. These three levels of control facilitate intelligent 
management of peripheral devices, diagnosis of malfunc- 
tioning peripheral devices, and isolation of malfunctioning 
peripheral devices. The three -tiered port bypass circuit con- 

35 trol is also extended to inter-multi-peripheral-device- 
enclosure connection ports, so that a malfunctioning multi- 
peripheral-device enclosure can be diagnosed and isolated 
from a communications medium connection the multi- 
peripheral-device enclosure to a host computer. Redundant 

20 port bypass circuit controllers and microprocessors can be 
used to improve reliability of the diagnosis and isolation 
strategies implemented using the three-tiered port bypass 
circuit control. 

25 BRIEF DESCRIPTION OF THE DRAWINGS 

FIGS. 1A-1C shows the three different types of FC 
interconnection topologies. 

FIG. 2 illustrates a very simple hierarchy by which data 
30 is organized, in time, for transfer through an FC network. 

FIG. 3 shows the contents of a standard FC frame. 

FIG. 4 is a block diagram of a common personal computer 
architecture including a SCSI bus. 
35 FIG. 5 illustrates the SCSI bus topology. 

FIGS. 6A-6C illustrate the SCSI protocol involved in the 
initiation and implementation of read and write I/O opera- 
tions. 

FIGS. 7A and 7B illustrate a mapping of FCP sequences 
40 exchanged between an initiator and target and the SCSI bus 
phases and states described in FIGS. 6A-6C. 

FIG. 8 shows a diagram of the seven phases of FC 
arbitrated loop initialization. 

FIG. 9 shows the data payload of FC frames transmitted 
45 by FC nodes in an arbitrated loop topology during each of 
the seven phases of loop initialization shown in FIG. 9. 

FIG. 10 illustrates a simple multi-peripheral devices 
enclosure. 

50 FIG. 11 illustrates the basic communications paradigm 
represented by the SES command set. 

FIG. 12 is a simplified illustration of the design used by 
manufacturers of certain currently-available FC-based 
multi-disk enclosures. 
55 FIG. 13 A is a schematic representation of a port bypass 
circuit, such as port bypass circuits 1222-1229 in FIG. 12. 

FIG. 13B illustrates the connection of a disk drive to a 
fibre channel loop via a port bypass circuit. 

FIG. 14 shows a highly available enclosure that incorpo- 
rates techniques related to the present invention. 

FIG. 15A illustrates control of a port bypass circuit by a 
port bypass circuit control chip. 

FIG. 15B shows an example of the PBC control circuit 
65 implemented in hardware. 

FIGS, 16A-B illustrate the usefulness of implementing a 
shunting operation in order to bypass a GBIC. 
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DETAILED DESCRIPTION OF THE 
INVENTION 

The present invention will be described below in six 
subsections. The first three subsections provide greater 
detail about the fibre channel architecture and protocol, the 5 
SCSI architecture and protocol, and implementation of the 
SCSI protocol on top of the fibre channel protocol. The 
fourth subsection discusses the fibre channel arbitrated loop 
intialization process. The fifth subsection provides a general 
description of multi-peripheral-device enclosures, and the 10 
sixth subsection describes a specialized SCSI command set 
and protocol used for component management within sys- 
tems of peripheral devices that communicate with one or 
more host computers via the SCSI protocol. The seventh 
subsection provides a detailed description of an embodiment 15 
of the present invention. 

Fibre Channel 

The Fibre Channel ("FC") is defined by, and described in, 
a number of ANSI Standards documents, including: (1) 20 
Fibre Channel Physical and Signaling Interface ("FC-PH"), 
ANSI X3.230-1994, ("FC-PH-2), ANSI X3.297-1997; (2) 
Fibre Channel— Arbitrated Loop ("FC-AL-2"), ANSI 
X3.272-1996; (3) Fibre Channel— Private Loop SCSI Direct 
Attached ("FC-PLDA"); (4) Fibre Channel— Fabric Loop 25 
Attachment ("FC-FLA ); (5) Fibre Channel Protocol for 
SCSI ("FCP"); (6) Fibre Channel Fabric Requirements 
("FC-FG"), ANSI X3.289:1996; and (7) Fibre Channel 
10-Bit Interface. These standards documents are under fre- 
quent revision. Additional Fibre Channel System Initiative 30 
("FCSI") standards documents include: (1) Gigabaud Link 
Module Family ("GLM"), FCSI-301; (2) Common FC-PH 
Feature Sets Profiles, FCSI-101; and (3) SCSI Profile, 
FCSI-201. These documents may be found at the world wide 
web Internet page having the following address: 35 

"http://www.fibrechannel.com" 
The following description of the FC is meant to introduce 
and summarize certain of the information contained in these 
documents in order to facilitate discussion of the present 
invention. If a more detailed discussion of any of the topics 40 
introduced in the following description is desired, the above- 
mentioned documents may be consulted. 

The FC is an architecture and protocol for data commu- 
nications between FC nodes, generally computers, 
workstations, peripheral devices, and arrays or collections of 45 
peripheral devices, such as disk arrays, interconnected by 
one or more communications media. Communications 
media include shielded twisted pair connections, coaxial 
cable, and optical fibers. An FC node is connected to a 
communications medium via at least one FC port and FC 50 
link. An FC port is an FC host adapter or FC controller that 
shares a register and memory interface with the processing 
components of the FC node, and that implements, in hard- 
ware and firmware, the lower levels of the FC protocol. The 
FC node generally exchanges data and control information 55 
with the FC port using shared data structures in shared 
memory and using control registers in the FC port. The FC 
port includes serial transmitter and receiver components 
coupled to a communications medium via a link that com- 
prises electrical wires or optical strands. 60 

In the following discussion, "FC* is used as an adjective 
to refer to the general Fibre Channel architecture and 
protocol, and is used as a noun to refer to an instance of a 
Fibre Channel communications medium. Thus, an FC 
(architecture and protocol) port may receive an FC 65 
(architecture and protocol) sequence from the FC 
(communications medium). 
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The FC architecture and protocol support three different 
types of interconnection topologies, shown in FIGS. 1A-1C. 
FIG. 1A shows the simplest of the three interconnected 
topologies, called the "point-to-point topology." In the 
point-to-point topology shown in FIG. 1A, a first node 101 
is directly connected to a second node 102 by directly 
coupling the transmitter 103 of the FC port 104 of the first 
node 101 to the receiver 105 of the FC port 106 of the second 
node 102, and by directly connecting the transmitter 107 of 
the FC port 106 of the second node 102 to the receiver 108 
of the FC port 104 of the first node 101. The ports 104 and 
106 used in the point-to-point topology are called N_J*orts. 

FIG. IB shows a somewhat more complex topology 
called the "FC arbitrated loop topology." FIG. IB shows 
four nodes 110-113 interconnected within an arbitrated 
loop. Signals, consisting of electrical or optical binary data, 
are transferred from one node to the next node around the 
loop in a circular fashion. The transmitter of one node, such 
as transmitter 114 associated with node 111, is directly 
connected to the receiver of the next node in the loop, in the 
case of transmitter 114, with the receiver 115 associated with 
node 112. Two types of FC ports may be used to interconnect 
FC nodes within an arbitrated loop. The most common type 
of port used in arbitrated loops is called the "NL__Port." A 
special type of port, called the "FL_Port," may be used to 
interconnect an FC arbitrated loop with an FC fabric 
topology, to be described below. Only one FL_Port may be 
actively incorporated into an arbitrated loop topology. An 
FC arbitrated loop topology may include up to 127 active FC 
ports, and may include additional non-participating FC 
ports. 

In the FC arbitrated loop topology, nodes contend for, or 
arbitrate for, control of the arbitrated loop. In general, the 
node with the lowest port address obtains control in the case 
that more than one node is contending for control. A fairness 
algorithm may be implemented by nodes to ensure that all 
nodes eventually receive control within a reasonable amount 
of time. When a node has acquired control of the loop, the 
node can open a channel to any other node within the 
arbitrated loop. In a half duplex channel, one node transmits 
and the other node receives data. In a full duplex channel, 
data may be transmitted by a first node and received by a 
second node at the same time that data is transmitted by the 
second node and received by the first node. For example, if, 
in the arbitrated loop of FIG. IB, node 111 opens a full 
duplex channel with node 113, then data transmitted through 
that channel from node 111 to node 113 passes through 
NL_Port 116 of node 112, and data transmitted by node 113 
to node 111 passes through NL_Port 117 of node 110. 

FIG. 1C shows the most general and most complex FC 
topology, called an "FC fabric." The FC fabric is represented 
in FIG. 1C by the irregularly shaped central object 118 to 
which four FC nodes 119-122 are connected. The N_Ports 
123-126 within the FC nodes 119-122 are connected to 
F _J*orts 127-130 within the fabric 118. The fabric is a 
switched or cross-point switch topology similar in function 
to a telephone system. Data is routed by the fabric between 
F _Ports through switches or exchanges called "fabric ele- 
ments." There may be many possible routes through the 
fabric between one F Jort and another F_Port. The routing 
of data and the addressing of nodes within the fabric 
associated with F_J*orts are handled by the FC fabric, rather 
than by FC nodes or N_Ports. 

When optical fibers are employed, a single FC fabric can 
extend for ten kilometers. The FC can support interconnec- 
tion of more than 16,000,000 FC nodes. A single FC host 
adapter can transmit and receive data at rates of up to 200 
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Mbytes per secoad. Much higher data exchange rates are 
planned for FC components in the near future. 

The FC is a serial communications medium. Data is 
transferred one bit at a time at extremely high transfer rates. 
FIG. 2 illustrates a very simple hierarchy by which data is 
organized, in time, for transfer through an FC network. At 
the lowest conceptual level, the data can be considered to be 
a stream of data bits 200. The smallest unit of data, or 
grouping of data bits, supported by an FC network is a 10-bit 
character that is decoded by FC port as an 8-bit character. FC 
primitives are composed of 10-byte characters or bytes. 
Certain FC primitives are employed to carry control infor- 
mation exchanged between FC ports. The next level of data 
organization, a fundamental level with regard to the FC 
protocol, is a frame. Seven frames 202-208 are shown in 
FIG. 2. A frame may be composed of between 36 and 2,148 
bytes of data, depending on the nature of the data included 
in the frame. The first FC frame, for example, corresponds 
to the data bits of the stream of data bits 200 encompassed 
by the horizontal bracket 201. The FC protocol specifies a 
next higher organizational level called the sequence. A first 
sequence 210 and a portion of a second sequence 212 are 
displayed in FIG. 2. The first sequence 210 is composed of 
frames one through four 202-205. The second sequence 212 
is composed of frames five through seven 206-208 and 
additional frames that are not shown. The FC protocol 
specifies a third organizational level called the exchange. A 
portion of an exchange 214 is shown in FIG. 2. This 
exchange 214 is composed of at least the first sequence 210 
and the second sequence 212 shown in FIG. 2. This 
exchange can alternatively be viewed as being composed of 
frames one through seven 202-208, and any additional 
frames contained in the second sequence 212 and in any 
additional sequences that compose the exchange 214. 

The FC is a full duplex data transmission medium. Frames 
and sequences can be simultaneously passed in both direc- 
tions between an originator, or initiator, and a responder, or 
target. An exchange comprises all sequences, and frames 
within the sequences, exchanged between an originator and 
a responder during a single I/O transaction, such as a read 
I/O transaction or a write I/O transaction. The FC protocol 
is designed to transfer data according to any number of 
higher-level data exchange protocols, including the Internet 
protocol ("IF'), the Small Computer Systems Interface 
("SCSI") protocol, the High Performance Parallel Interface 
("HIPPI"), and the Intelligent Peripheral Interface ("IPI"). 
The SCSI bus architecture will be discussed in the following 
subsection, and much of the subsequent discussion in this 
and remaining subsections will focus on the SCSI protocol 
embedded within the FC protocol. The standard adaptation 
of SCSI protocol to fibre channel is subsequently referred to 
in this document as "FCP.", Thus, the FC can support a 
master-slave type communications paradigm that is charac- 
teristic of the SCSI bus and other peripheral interconnection 
buses, as well as the relatively open and unstructured 
communication protocols such as those used to implement 
the Internet. The SCSI bus architecture concepts of an 
initiator and target are carried forward in the FCP, designed, 
as noted above, to encapsulate SCSI commands and data 
exchanges for transport through the FC. 

FIG. 3 shows the contents of a standard FC frame. The FC 
frame 302 comprises five high level sections 304, 306, 308, 
310 and 312. The first high level section, called the start- 
of- frame deliminator 304, comprises 4 bytes that mark the 
beginning of the frame. The next high level section, called 
frame header 306, comprises 24 bytes that contain address- 
ing information, sequence information, exchange 



information, and various control flags. A more detailed view 
of the frame header 314 is shown expanded from the FC 
frame 302 in FIG. 3. The destination identifier ("D_DD"), or 
DESHNATION_JD 316, is a 24-bit FC address indicating 

5 the destination FC port for the frame. The source identifier 
("S _JD"), or SOURCE.JD 318, is a 24-bit address that 
indicates the FC port that transmitted the frame. The origi- 
nator ID, or OJLJD 320, and the responder ID 322, or 
RX__ID, together compose a 32-bit exchange ID that iden- 

10 tifies the exchange to which the frame belongs with respect 
to the originator, or initiator, and responder, or target, FC 
ports. The sequence ID, or SEQJD, 324 identifies the 
sequence to which the frame belongs. 

The next high level section 308, called the data payload, 

15 contains the actual data packaged within the FC frame. The 
data payload contains data and encapsulating protocol infor- 
mation that is being transferred according to a higher-level 
protocol, such as IP and SCSI. FIG. 3 shows four basic types 
of data payload layouts 326-329 used for data transfer 

20 according to the SCSI protocol The first of these formats 
326, called the FCP_CMND, is used to send a SCSI 
command from an initiator to a target. The FCP_LUN field 
330 comprises an 8-byte address that may, in certain 
implementations, specify a particular SCSI-bus adapter, a 

25 target device associated with that SCSI -bus adapter, and a 
logical unit number ("LUN") corresponding to a logical 
device associated with the specified target SCSI device that 
together represent the target for the FCP_CMND. In other 
implementations, the FCP_LUN field 330 contains an index 

30 or reference number that can be used by the target FC host 
adapter to determine the SCSI-bus adapter, a target device 
associated with that SCSI-bus adapter, and a LUN corre- 
sponding to a logical device associated with the specified 
target SCSI device. An actual SCSI command, such as a 

35 SCSI read or write I/O command, is contained within the 
16-byte field FCP_CDB 332. 

The second type of data payload format 327 shown in 
FIG. 3 is called the FCP_JXFER__KDY layout. This data 
payload format is used to transfer a SCSI proceed command 

40 from the target to the initiator when the target is prepared to 
begin receiving or sending data. The third type of data 
payload format 328 shown in FIG. 3 is the FCP_DATA 
format, used for transferring the actual data that is being read 
or written as a result of execution of a SCSI I/O transaction. 

45 The final data payload format 329 shown in FIG. 3 is called 
the FCP_JISP layout, used to transfer a SCSI status byte 
334, as well as other FCP status information, from the target 
back to the initiator upon completion of the I/O transaction. 

5Q The SCSI Bus Architecture 

A computer bus is a set of electrical signal lines through 
which computer commands and data are transmitted 
between processing, storage, and input/output ("1/0") com- 
ponents of a computer system. The SCSI I/O bus is the most 

55 widespread and popular computer bus for interconnecting 
mass storage devices, such as hard disks and CD-ROM 
drives, with the memory and processing components of 
computer systems. The SCSI bus architecture is defined in 
three major standards: SCSI-1, SCSI-2 and SCSI-3. The 

60 SCSI-1 and SCSI-2 standards are published in the American 
National Standards Institute ("ANSI") standards documents 
"X3.131-1986," and "X3. 131-1994," respectively. The 
SCSI-3 standard is currently being developed by an ANSI 
committee. An overview of the SCSI bus architecture is 

65 provided by "The SCSI Bus and IDE Interface/' Freidhelm 
Schmidt, Addison-Wesley Publishing Company, ISBN 
0-201-17514-2, 1997 ("Schmidt"). 
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FIG. 4 is a block diagram of a common personal computer 
("PC") architecture including a SCSI bus. The PC 400 
includes a central processing unit, or processor ("CPU") 
402, linked to a system controller 404 by a high-speed CPU 
bus 406. The system controller is, in turn, linked to a system 5 
memory component 408 via a memory bus 410. The system 
controller 404 is, in addition, linked to various peripheral 
devices via a peripheral component interconnect ("PCI") bus 
412 that is interconnected with a slower industry standard 
architecture ("ISA") bus 414 and a SCSI bus 416. The 10 
architecture of the PCI bus is described in "PCI System 
Architecture," Shanley & Anderson, Mine Share, Inc., 
Addison-Wesley Publishing Company, ISBN 0-201-40993- 
3, 1995. The interconnected CPU bus 406, memory bus 410, 
PQ bus 412, and ISA bus 414 allow the CPU to exchange 15 
data and commands with the various processing and 
memory components and I/O devices included in the com- 
puter system. Generally, very high-speed and high band- 
width I/O devices, such as a video display device 418, are 
directly connected to the PCI bus. Slow I/O devices 420, ^ 
such as a keyboard 420 and a pointing device (not shown), 
are connected directly to the ISA bus 414. The ISA bus is 
interconnected with the PCI bus through a bus bridge 
component 422. Mass storage devices, such as hard disks, 
floppy disk drives, CD-ROM drives, and tape drives ^ 
424-426 are connected to the SCSI bus 416. The SCSI bus 
is interconnected with the PCI bus 412 via a SCSI-bus 
adapter 430. The SCSI-bus adapter 430 includes a processor 
component, such as processor selected from the Symbios 
family of 53C8xx SCSI processors, and interfaces to the PCI 30 
bus 412 using standard PCI bus protocols. The SCSI-bus 
adapter 430 interfaces to the SCSI bus 416 using the SCSI 
bus protocol that will be described, in part, below. The 
SCSI-bus adapter 430 exchanges commands and data with 
SCSI controllers (not shown) that are generally embedded 35 
within each mass storage device 424—426, or SCSI device, 
connected to the SCSI bus. The SCSI controller is a 
hardware/firmware component that interprets and responds 
to SCSI commands received from a SCSI adapter via the 
SCSI bus and that implements the SCSI commands by 40 
interfacing with, and controlling, logical devices. A logical 
device may correspond to one or more physical devices, or 
to portions of one or more physical devices. Physical devices 
include data storage devices such as disk, tape and CD-ROM 
drives. 45 

Two important types of commands, called I/O commands, 
direct the SCSI device to read data from a logical device and 
write data to a logical device. An I/O transaction is the 
exchange of data between two components of the computer 
system, generally initiated by a processing component, such 50 
as the CPU 402, that is implemented, in part, by a read I/O 
command or by a write I/O command. Thus, I/O transactions 
include read I/O transactions and write I/O transactions. 

The SCSI bus 416 is a parallel bus that can simultaneously 
transport a number of data bits. The number of data bits that 55 
can be simultaneously transported by the SCSI bus is 
referred to as the width of the bus. Different types of SCSI 
buses have widths of 8, 16 and 32 bits. The 16 and 32-bit 
SCSI buses are referred to as wide SCSI buses. 

As with all computer buses and processors, the SCSI bus 60 
is controlled by a clock that determines the speed of opera- 
tions and data transfer on the bus. SCSI buses vary in clock 
speed. The combination of the width of a SCSI bus and the 
clock rate at which the SCSI bus operates determines the 
number of bytes that can be transported through the SCSI 65 
bus per second, or bandwidth of the SCSI bus. Different 
types of SCSI buses have bandwidths ranging from less than 
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2 megabytes ("Mbytes") per second up to 40 Mbytes per 
second, with increases to 80 Mbytes per second and possibly 
160 Mbytes per second planned for the future. The increas- 
ing bandwidths may be accompanied by increasing limita- 
tions in the physical length of the SCSI bus. 

FIG. 5 illustrates the SCSI bus topology. A computer 
system 502, or other hardware system, may include one or 
more SCSI-bus adapters 504 and 506. The SCSI-bus 
adapter, the SCSI bus which the SCSI-bus adapter controls, 
and any peripheral devices attached to thai SCSI bus 
together comprise a domain. SCSI-bus adapter 504 in FIG. 
5 is associated with a first domain 508 and SCSI -bus adapter 
506 is associated with a second domain 510. The most 
current SCSI-2 bus implementation allows fifteen different 
SCSI devices 513-515 and 516-517 to be attached to a 
single SCSI bus. In FIG. 5, SCSI devices 513-515 are 
attached to SCSI bus 518 controlled by SCSI-bus adapter 
506, and SCSI devices 516-517 are attached to SCSI bus 
520 controlled by SCSI-bus adapter 504. Each SCSI-bus 
adapter and SCSI device has a SCSI identification number, 
or SCSI_ID, that uniquely identifies the device or adapter in 
a particular SCSI bus. By convention, the SCSI -bus adapter 
has SCSI__ID 7, and the SCSI devices attached to the SCSI 
bus have SCSLJDs ranging from 0 to 6 and from 8 to 15. 
A SCSI device, such as SCSI device 513, may interface with 
a number of logical devices, each logical device comprising 
portions of one or more physical devices. Each logical 
device is identified by a logical unit number ("LUN") that 
uniquely identifies the logical device with respect to the 
SCSI device that controls the logical device. For example, 
SCSI device 513 controls logical devices 522-524 having 
LUNs 0, 1, and 2, respectively. According to SCSI 
terminology, a device that initiates an I/O command on the 
SCSI bus is called an initiator, and a SCSI device that 
receives an I/O command over the SCSI bus that directs the 
SCSI device to execute an I/O operation is called a target. 

In general, a SCSI-bus adapter, such as SCSI-bus adapters 
504 and 506, initiates I/O operations by sending commands 
to target devices. The target devices 513-515 and 516-517 
receive the 1/0 commands from the SCSI bus. The target 
devices 513-515 and 516-517 then implement the com- 
mands by interfacing with one or more logical devices that 
they control to either read data from the logical devices and 
return the data through the SCSI bus to the initiator or to 
write data received through the SCSI bus from the initiator 
to the logical devices. Finally, the target devices 513-515 
and 516-517 respond to the initiator through the SCSI bus 
with status messages that indicate the success or failure of 
implementation of the commands. 

FIGS. 6A-6C illustrate the SCSI protocol involved in the 
initiation and implementation of read and write I/O opera- 
tions. Read and write I/O operations compose the bulk of I/O 
operations performed by SCSI devices. Efforts to maximize 
the efficiency of operation of a system of mass storage 
devices interconnected by a SCSI bus are most commonly 
directed toward maximizing the efficiency at which read and 
write I/O operations are performed. Thus, in the discussions 
to follow, the architectural features of various hardware 
devices will be discussed in terms of read and write opera- 
tions. 

FIG. 6 A shows the sending of a read or write I/O 
command by a SCSI initiator, most commonly a SCSI-bus 
adapter, to a SCSI target, most commonly a SCSI controller 
embedded in a SCSI device associated with one or more 
logical devices. The sending of a read or write I/O command 
is called the command phase of a SCSI I/O operation. FIG. 
6A is divided into initiator 602 and target 604 sections by a 
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central vertical line 606. Both the initiator and the target 
sections include columns entitled "state" 606 and 608 that 
describe the state of the SCSI bus and columns entitled 
"events'* 610 and 612 that describe the SCSI bus events 
associated with the initiator and the target, respectively. The 5 
bus states and bus events involved in the sending of the I/O 
command are ordered in time, descending from the top of 
FIG. 6Ato the bottom of FIG. 6A. FIGS. 6B-6C also adhere 
to this above-described format. 

The sending of an I/O command from an initiator SCSI- 10 
bus adapter to a target SCSI device, illustrated in FIG. 6 A, 
initiates a read or write I/O operation by the target SCSI 
device. Referring to FIG. 4, the SCSI-bus adapter 430 
initiates the I/O operation as part of an I/O transaction. 
Generally, the SCSI-bus adapter 430 receives a read or write 15 
command via the PCI bus 412, system controller 404, and 
CPU bus 406, from the CPU 402 directing the SCSI-bus 
adapter to perform either a read operation or a write opera- 
tion. In a read operation, the CPU 402 directs the SCSI-bus 
adapter 430 to read data from a mass storage device 424-426 20 
and transfer that data via the SCSI bus 416, PCI bus 412, 
system controller 404, and memory bus 410 to a location 
within the system memory 408. In a write operation, the 
CPU 402 directs the system controller 404 to transfer data 
from the system memory 408 via the memory bus 410, 25 
system controller 404, and PCI bus 412 to the SCSI-bus 
adapter 430, and directs the SCSI-bus adapter 430 to send 
the data via the SCSI bus 416 to a mass storage device 
424-426 on which the data is written. 

FIG. 6A starts with the SCSI bus in the BUS FREE state 30 
614, indicating that there are no commands or data currently 
being transported on the. SCSI device. The initiator, or 
SCSI-bus adapter, asserts the BSY, D7 and SEL signal lines 
of the SCSI bus in order to cause the bus to enter the 
ARBITRATION state 616. In this state, the initiator 35 
announces to all of the devices an intent to transmit a 
command on the SCSI bus. Arbitration is necessary because 
only one device may control operation of the SCSI bus at 
any instant in time. Assuming that the initiator gains control 
of the SCSI bus, the initiator then asserts the ATN signal line 40 
and the DX signal line corresponding to the target SCSUD 
in order to cause the SCSI bus to enter the SELECTION 
state 618. The initiator or target asserts and drops various 
SCSI signal lines in a particular sequence in order to effect 
a SCSI bus state change, such as the change of state from the 45 
ARBITRATION state 616 to the SELECTION state 618, 
described above. These sequences can be found in Schmidt 
and in the ANSI standards, and will therefore not be further 
described below. 

When the target senses that the target has been selected by 50 
the initiator, the target assumes control 620 of the SCSI bus 
in order to complete the command phase of the I/O opera- 
tion. The target then controls the SCSI signal lines in order 
to enter the MESSAGE OUT state 622. In a first event that 
occurs in the MESSAGE OUT state, the target receives from 55 
the initiator an IDENTIFY message 623. The IDENTIFY 
message 623 contains a LUN field 624 that identifies the 
LUN to which the command message that will follow is 
addressed. The IDENTIFY message 623 also contains a flag 

625 that is generally set to indicate to the target that the 60 
target is authorized to disconnect from the SCSI bus during 
the target's implementation of the I/O command that will 
follow. The target then receives a QUEUE TAG message 

626 that indicates to the target how the I/O command that 
will follow should be queued, as well as providing the target 65 
with a queue tag 627. The queue tag is a byte that identifies 
the I/O command. A SCSI-bus adapter can therefore con- 
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currendy manage 656 different I/O commands per LUN. The 
combination of the SCS1_ID of the initiator SCSI -bus 
adapter, the SCSI_ID of the target SCSI device, the target 
LUN, and the queue tag together comprise an I_T_L_Q 
nexus reference number that uniquely identifies the I/O 
operation corresponding to the I/O command that will 
follow within the SCSI bus. Next, the target device controls 
the SCSI bus signal fines in order to enter the COMMAND 
state 628. In the COMMAND state, the target solicits and 
receives from the initiator the I/O command 630, The I/O 
command 630 includes an opcode 632 that identifies the 
particular command to be executed, in this case a read 
command or a write command, a logical block number 636 
that identifies the logical block of the logical device that will 
be the beginning point of the read or write operation 
specified by the command, and a data length 638 that 
specifies the number of blocks that will be read or written 
during execution of the command. 

When the target has received and processed the I/O 
command, the target device controls the SCSI bus signal 
lines in order to enter the MESSAGE IN state 640 in which 
the target device generally sends a disconnect message 642 
back to the initiator device. The target disconnects from the 
SCSI bus because, in general, the target will begin to interact 
with the logical device in order to prepare the logical device 
for the read or write operation specified by the command. 
The target may need to prepare buffers for receiving data, 
and, in the case of disk drives or CD-ROM drives, the target 
device may direct the logical device to seek to the appro- 
priate block specified as the starting point for the read or 
write command. By disconnecting, the target device frees up 
the SCSI bus for transportation of additional messages, 
commands, or data between the SCSI -bus adapter and the 
target devices. In this way, a large number of different I/O 
operations can be concurrently multiplexed over the SCSI 
bus. Finally, the target device drops the BSY signal line in 
order to return the SCSI bus to the BUS FREE state 644. 

The target device then prepares the logical device for the 
read or write operation. When the logical device is ready for 
reading or writing data, the data phase for the I/O operation 
ensues. FIG. 6B illustrates the data phase of a SCSI I/O 
operation. The SCSI bus is initially in the BUS FREE state 
646. The target device, now ready to either return data in 
response to a read I/O command or accept data in response 
to a write I/O command, controls the SCSI bus signal lines 
in order to enter the ARBITRATION state 648. Assuming 
that the target device is successful in arbitrating for control 
of the SCSI bus, the target device controls the SCSI bus 
signal lines in order to enter the RESELECTION state 650. 
The RESELECTION state is similar to the SELECTION 
state, described in the above discussion of FIG. 6A, except 
that it is the target device that is making the selection of a 
SCSI-bus adapter with which to communicate in the RESE- 
LECTION state, rather than the SCSI-bus adapter selecting 
a target device in the SELECTION state. 

Once the target device has selected the SCSI-bus adapter, 
the target device manipulates the SCSI bus signal lines in 
order to cause the SCSI bus to enter the MESSAGE IN state 
652. In the MESSAGE IN state, the target device sends both 
an IDENTIFY message 654 and a QUEUE TAG message 
656 to the SCSI-bus adapter. These messages are identical to 
the IDENTITY and QUEUE TAG messages sent by the 
initiator to the target device during transmission of the I/O 
command from the initiator to the target, illustrated in FIG. 
6 A. The initiator may use the I_T_L_Q nexus reference 
number, a combination of the SCSLJDs of the initiator and 
target device, the target LUN, and the queue tag contained 
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in the QUEUE TAG message, to identify the I/O transaction 
for which data will be subsequently sent from the target to 
the initiator, in the case of a read operation, or to which data 
will be subsequently transmitted by the initiator, in the case 
of a write operation. The I_T_L_Q nexus reference num- 
ber is thus an I/O operation handle that can be used by the 
SCSI-bus adapter as an index into a table of outstanding I/O 
commands in order to locate the appropriate buffer for 
receiving data from the target device, in case of a read, or for 
transmitting data to the target device, in case of a write. 

After sending the IDENTIFY and QUEUE TAG 
messages, the target device controls the SCSI signal lines in 
order to transition to a DATA state 658. In the case of a read 
I/O operation, the SCSI bus will transition to the DATA IN 
state. In the case of a write I/O operation, the SCSI bus will 
transition to a DATA. OUT state. During the time that the 
SCSI bus is in the DATA state, the target device will 
transmit, during each SCSI bus clock cycle, a data unit 
having a size, in bits, equal to the width of the particular 
SCSI bus on which the data is being transmitted. In general, 
there is a SCSI bus signal line handshake involving the 
signal lines ACK and REQ as part of the transfer of each unit 
of data. In the case of a read I/O command, for example, the 
target device places the next data unit on the SCSI bus and 
asserts the REQ signal line. The initiator senses assertion of 
the REQ signal line, retrieves the transmitted data from the 
SCSI bus, and asserts the ACK signal line to acknowledge 
receipt of the data. This type of data transfer is called 
asynchronous transfer. The SCSI bus protocol also allows 
for the target device to transfer a certain number of data units 
prior to receiving the first acknowledgment from the initia- 
tor. In this transfer mode, called synchronous transfer, the 
latency between the sending of the first data unit and receipt 
of acknowledgment for that transmission is avoided. During 
data transmission, the target device can interrupt the data 
transmission by sending a SAVE POINTERS message fol- 
lowed by a DISCONNECT message to the initiator and then 
controlling the SCSI bus signal lines to enter the BUS FREE 
state. This allows the target device to pause in order to 
interact with the logical devices which the target device 
controls before receiving or transmitting further data. After 
disconnecting from the SCSI bus, the target device may then 
later again arbitrate for control of the SCSI bus and send 
additional IDENTIFY and QUEUE TAG messages to the 
initiator so that the initiator can resume data reception or 
transfer at the point that the initiator was interrupted. An 
example of disconnect and reconnect 660 are shown in FIG. 
3B interrupting the DATA state 658. Finally, when all the 
data for the I/O operation has been transmitted, the target 
device controls the SCSI signal lines in order to enter the 
MESSAGE IN state 662, in which the target device sends a 
DISCONNECT message to the initiator, optionally preceded 
by a SAVE POINTERS message. After sending the DIS- 
CONNECT message, the target device drops the BSY signal 
line so the SCSI bus transitions to the BUS FREE state 664. 

Following the transmission of the data for the I/O 
operation, as illustrated in FIG. 6B, the target device returns 
a status to the initiator during the status phase of the I/O 
operation. FIG. 6C illustrates the status phase of the I/O 
operation. As in FIGS. 6A-6B, the SCSI bus transitions 
from the BUS FREE state 666 to the ARBITRATION state 
668, RESELECTION state 670, and MESSAGE IN state 
672, as in FIG. 3B. Following transmission of an IDENTIFY 
message 674 and QUEUE TAG message 676 by the target 
to the initiator during the MESSAGE IN state 672, the target 
device controls the SCSI bus signal lines in order to enter the 
STATUS state 678. In the STATUS state 678, the target 
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device sends a single status byte 684 to the initiator to 
indicate whether or not the I/O command was successfully 
completed. In FIG. 6C, the status byte 680 corresponding to 
a successful completion, indicated by a status code of 0, is 
5 shown being sent from the target device to the initiator. 
Following transmission of the status byte, the target device 
then controls the SCSI bus signal lines in order to enter the 
MESSAGE IN state 682, in which the target device sends a 
COMMAND COMPLETE message 684 to the initiator. At 
10 this point, the I/O operation has been completed. The target 
device then drops the BSY signal line so that the SCSI bus 
returns to the BUS FREE state 686. The SCSI-bus adapter 
can now finish its portion of the I/O command, free up any 
internal resources that were allocated in order to execute the 
15 command, and return a completion message or status back 
to the CPU via the PCI bus. 

Mapping the SCSI Protocol onto FCP 

FIGS. 7 A and 7B illustrate a mapping of FCP sequences 

20 exchanged between an initiator and target and the SCSI bus 
phases and states described in FIGS. 6A-6C. In FIGS. 
7A-7B, the target SCSI adapter is assumed to be packaged 
together with a FCP host adapter, so that the target SCSI 
adapter can communicate with the initiator via the FC and 

25 with a target SCSI device via the SCSI bus. FIG. 7A shows 
a mapping between FCP sequences and SCSI phases and 
states for a read I/O transaction. The transaction is initiated 
when the initiator sends a single -frame FCP sequence con- 
taining a FCP_CMND data payload through the FC to a 

30 target SCSI adapter 702. When the target SCSI-bus adapter 
receives the FCP_CMND frame, the target SCSI-bus 
adapter proceeds through the SCSI states of the command 
phase 704 illustrated in FIG. 6A, including ARBITRATION, 
RESELECTION, MESSAGE OUT, COMMAND, and 

35 MESSAGE IN. At the conclusion of the command phase, as 
illustrated in FIG. 6A, the SCSI device that is the target of 
the I/O transaction disconnects from the SCSI bus in order 
to free up the SCSI bus while the target SCSI device 
prepares to execute the transaction. Later, the target SCSI 

40 device rearbitrates for SCSI bus control and begins the data 
phase of the I/O transaction 706. At this point, the SCSI-bus 
adapter may send a FCP_XFER_RDY single-frame 
sequence 708 back to the initiator to indicate that data 
transmission can now proceed. In the case of a read I/O 

45 transaction, the FCP__XFER_RDY single-frame sequence 
is optional. As the data phase continues, the target SCSI 
device begins to read data from a logical device and transmit 
that data over the SCSI bus to the target SCSI-bus adapter. 
The target SCSI-bus adapter then packages the data received 

50 from the target SCSI device into a number of FCP_DATA 
frames that together compose the third sequence of the 
exchange corresponding to the I/O read transaction, and 
transmits those FCP_DATA frames back to the initiator 
through the FC. When all the data has been transmitted, and 

55 the target SCSI device has given up control of the SCSI bus, 
the target SCSI device then again arbitrates for control of the 
SCSI bus to initiate the status phase of the I/O transaction 
714. In this phase, the SCSI bus transitions from the BUS 
FREE state through the ARBITRATION, RESELECTION, 

60 MESSAGE IN, STATUS, MESSAGE IN and BUS FREE 
states, as illustrated in FIG. 3C, in order to send a SCSI 
status byte from the target SCSI device to the target SCSI- 
bus adapter. Upon receiving the status byte, the target 
SCSI-bus adapter packages the status byte into an FCP_ 

65 RSP single-frame sequence 716 and transmits the FCP _J*SP 
single-frame sequence back to the initiator through the FC. 
This completes the read I/O transaction. 
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In many computer systems, there may be additional 
internal computer buses, such as a PCI bus, between the 
target FC host adapter and the target SCSI -bus adapter. In 
other words, the FC host adapter and SCSI adapter may not 
be packaged together in a single target component. In the s 
interest of simplicity, that additional interconnection is not 
shown in FIGS. 7A-B. 

FIG. 7B shows, in similar fashion to FIG. 7A, a mapping 
between FCP sequences and SCSI bus phases and states 
during a write I/O transaction indicated by a FCP_CMND 10 
frame 718. FIG. 7B differs from FIG. 7A only in the fact 

that, during a write transaction, the FCP DATA frames 

722-725 are transmitted from the initiator to the target over 
the FC and the FCP_XFER_RDY single-frame sequence 
720 sent from the target to the initiator 720 is not optional, 15 
as in the case of the read I/O transaction, but is instead 
mandatory. As in FIG. 7 A, the write I/O transaction includes 
when the target returns an FCP__RSP single-frame sequence 
726 to the initiator. 

on 

Arbitrated Loop Initialization 

As discussed above, the FC frame header contains fields 
that specify the source and destination fabric addresses of 
the FC frame. Both the D_JD and the S_ID are 3-byte 
quantities that specify a three -part fabric address for a 25 
particular FC port. These three parts include specification of 
an FC domain, an FC node address, and an FC port within 
the FC node. In an arbitrated loop topology, each of the 127 
possible active nodes acquires, during loop initialization, an 
arbitrated loop physical address ("AL_PA"). The AL _PAis 3Q 
a 1-byte quantity that corresponds to the FC port specifica- 
tion within the D_ID and S_ID of the FC frame header. 
Because there are at most 127 active nodes interconnected 
by an arbitrated loop topology, the single byte AL_PA is 
sufficient to uniquely address each node within the arbitrated 
loop. 35 

The loop initialization process may be undertaken by a 
node connected to an arbitrated loop topology for any of a 
variety of different reasons, including loop initialization 
following a power reset of the node, initialization upon start 
up of the first node of the arbitrated loop, subsequent 40 
inclusion of an FC node into an already operating arbitrated 
loop, and various error recovery operations. FC arbitrated 
loop initialization comprises seven distinct phases. FIG. 8 
shows a diagram of the seven phases of FC arbitrated loop 
initialization. FIG. 9 shows the data payload of FC frames 45 
transmitted by FC nodes in an arbitrated loop topology 
during each of the seven phases of loop initialization shown 
in FIG. 9. The data payload for the FC frames used in each 
of the different phases of loop initialization comprises three 
different fields, shown as columns 902_904 in FIG. 9. The 50 
first field 902 within each of the different data payload 
structures is the LI_ID field. The LI_ID field contains an 
16-bit code corresponding to one of the seven phases of 
group initialization. The LI_FL field 903 for each of the 
different data payload layouts shown in FIG. 9 contains 
various flags, including flags that specify whether the final 
two phases of loop initialization are supported by a particu- 
lar FC port. The TL supports all seven phases of loop 
initialization. Finally, the data portion of the data payload of 
each of the data payload layouts 904 contains data fields of 
varying lengths specific to each of the seven phases of loop 60 
initialization. In the following discussion, the seven phases 
of loop initialization will be described with references to 
both FIGS. 8 and 9. 

In the first phase of loop initialization 802, called 
"LISM," a loop initialization master is selected. This first 65 
phase of loop initialization follows flooding of the loop with 
loop initialization primitives ("LIPs"). All active nodes 
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transmit an USM FC arbitrated loop initialization frame 906 
that includes the transmitting node's 8-byte port name. Each 
FC port participating in loop initialization continues to 
transmit USM FC arbitrated loop initialization frames and 
continues to forward any received USM FC arbitrated loop 
initialization frames to subsequent FC nodes in the arbitrated 
loop until either the FC port detects an FC frame transmitted 
by another FC port having a lower combined port address, 
where a combined port address comprises the D_ID, S_JD, 
and 8-byte port name, in which case the other FC port will 
become the loop initialization master ("UM"), or until the 
FC port receives back an FC arbitrated loop initialization 
frame that that FC port originally transmitted, in which case 
the FC port becomes the LIM. Thus, in general, the node 
having the lowest combined address that is participating in 
the FC arbitrated loop initialization process becomes the 
UM. By definition, an FL_PORT will have the lowest 
combined address and will become UM. At each of the loop 
initialization phases, loop initialization may fail for a variety 
of different reasons, requiring the entire loop initialization 
process to be restarted. 

Once an LIM has been selected, loop initialization pro- 
ceeds to the UFA phase 804, in which any node having a 
fabric assigned AL_PA can attempt to acquire that AL _PA. 
The UM transmits an FC arbitrated loop initialization frame 
having a data payload formatted according to the data 
payload layout 908 in FIG. 9. The data field of this data 
layout contains a 16-byte AL_PAbit map. The LIM sets the 
bit within the bit map corresponding to its fabric assigned 
AL_PA, if the LIM has a fabric assigned AL __PA. As this 
FC frame circulates through each FC port within the arbi- 
trated loop, each FC node also sets a bit in the bit map to 
indicate that FC nodes fabric-assigned AL__PA, if that node 
has a fabric assigned AL__PA If the data in the bit map has 
already been set by another FC node in the arbitrated loop, 
then the FC node must attempt to acquire an AL_PA during 
one of three subsequent group initialization phases. The 
fabric assigned AL_PAs provide a means for AL_PAs to be 
specified by an FC node connected to the arbitrated loop via 
an FL__Port. 

In the UPAloop initialization phase 806, the LIM trans- 
mits an FC frame containing a data payload formatted 
according to the data layout 910 in FIG. 9. The data field 
contains the AL__PA bit map returned to the UM during the 
previous LIPA phase of loop initialization. During the UPA 
phase 910, the LIM and other FC nodes in the arbitrated loop 
that have not yet acquired an AL_PAmay attempt to set bits 
within the bit map corresponding to a previously acquired 
AL_PA saved within the memory of the FC nodes. If an FC 
node receives the LIPA FC frame and detects that the bit 
within the bit map corresponding to that node's previously 
acquired AL_PAhas not been set, the FC node can set that 
bit and thereby acquire that ALJA. 

The next two phases of loop initialization, LIHA 808 and 
USA 810 are analogous to the above-discussed LIPA phase 
806. Both the LIHA phase 808 and the USA phase 810 
employ FC frames with data payloads 912 and 914 similar 
to the data layout for the UPA phase 910 and UFA phase 
908. The bit map from the previous phase is recirculated by 
the UM in both the UHA 808 and USA 810 phases, so that 
any FC port in the arbitrated loop that has not yet acquired 
an AL __PA may attempt to acquire either a hard assigned 
AL__PA contained in the port's memory, or, at last resort, 
may obtain an arbitrary, or soft, AL_PAnot yet acquired by 
any of the other FC ports in the arbitrated loop topology. If 
an FC port is not able to acquire an AL_PA at the comple- 
tion of the USA phase 810, then that FC port may not 
participate in the arbitrated loop. The FC-AL-2 standard 
contains various provisions to enable a nonparticipating 
node to attempt to join the arbitrated loop, including restart- 
ing the loop initialization process. 
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In the L1RP phase of loop initialization 812, the LIM 
transmits an FC frame containing a data payload having the 
data layout 916 in FIG. 9. The data field 917 of this data 
layout 916 contains a 128-byle AL_PA position map. The 
LIM places the LIM's acquired AL_PA, if the LIM has 
acquired an AL_PA, into the first AL„PA position within 
the AL_PA position map, following an AL_PA count byte 
at byte 0 in the data field 917, and each successive FC node 
that receives and retransmits the LIRP FC arbitrated loop 
initialization frame places that FC node's AL_PA in suc- 
cessive positions within the AL_PA position map. In the 
final loop initialization phase LJLP 814, the AL_PA position 
map is recirculated by the UM through each FC port in the 
arbitrated loop technology so that the FC ports can acquire, 
and save in memory, the completed AL.JPA position map. 
This AL_PA position map allows each FC port within the 
arbitrated loop to determine its position relative to the other 
FC ports within the arbitrated loop. 

The SCSI-3 Enclosure Services Commands 



10 



15 



20 



30 



35 



During the past decade, it has become increasingly popu 
lar for computer peripheral manufacturers to include a 
number of different peripheral devices within a single enclo- 
sure. One example of such enclosures is a redundant array 
of inexpensive disks ("RAID"). By grouping a number of 
different peripheral devices within a single enclosure, the 25 
peripheral manufacturer can achieve certain economies of 
manufacture. For example, all of the peripheral devices 
within the enclosure may share one or more common power 
supplies, cooling apparati, and interconnect media. Such 
enclosures may provide a collective set of resources greater 
than the resource represented by individual peripheral 
devices. In addition, individual peripheral devices may be 
swapped in and out of the enclosure while the other periph- 
eral devices within the enclosure continue to operate, a 
process known as hot-swapping. Finally, banks of such 
enclosures may be used for storage redundancy and mirror- 
ing in order to achieve economical, highly available 
resources. 

FIG. 10 illustrates a simple multi-peripheral devices 
enclosure. The enclosure 1002 includes a power supply 
1004, a cooling fan 1006, four disk drives 1008-1011. A 40 
circuit board 1014 within the enclosure includes a processor 
1016, an internal bus 1018, and an interconnection medium 
1020 that interconnects the processor 1016, the disk drive 
1008-1011, and a port 1022 through which the enclosure 
1002 can be connected to a host computer (not shown). The 45 
host computer may, in some systems, individually address 
and interact with the disk drives 1008-1011 as well as with 
the processor 1016, or may instead interact with the enclo- 
sure 1002 as if the enclosure represented one very large disk 
drive with a single address base. The processor 1016 gen- 
erally runs a process that may monitor status of each of the 
peripheral devices 1008-1011 within the enclosure 1002 as 
well as the status of the power supply 1004 and the cooling 
fan 1006. The processor 1016 communicates with the power 
supply 1004 and the cooling fan 1006 via an internal 
communications medium such as, in FIG. 10, an internal bus 
1018. 

In order to facilitate host computer access to information 
provided by various components within an enclosure, such 
as the power supply 1004 and the cooling fan 1006 and in 
order to provide the host computer with the ability to 
individually control various components within the 
enclosure, a SCSI command set has been defined as a 
communications standard for communications between a 
host computer and an enclosure services process running 
within an enclosure, such as enclosure 1002 in FIG. 10. The 
SCSI Enclosure Services ("SES") command set is described 
in the American National Standard for Information Tech- 



nology Standards Document NCITS 305-199X. The SES 
command set will be defined in a reference standard that is 
currently still under development by the X3T10 Committee. 

FIG. 11 illustrates the basic communications paradigm 
represented by the SES command set. A host computer 1102 
sends an SES command 1104 to an enclosure services 
process 1106 running within an enclosure 1108. In FIG. 10, 
for example, the enclosure services process runs on proces- 
sor 1016. The enclosure services process 1106 interacts with 
various components 1110-1113 within the enclosure 1108 
and then returns a response 1114 to the SES command sent 
to the enclosure services process 1106 by the host computer 
1102. 

There are a number of different types of SES commands 
and responses to SES commands. The above cited ANSI 
standard documents may be consulted for details on the 
various types of commands and responses. In general, the 
bulk of communications traffic between a host computer 
1102 and an enclosure services process 1106 involves two 
basic commands: (1) the SEND DIAGNOSTICS command 
by which the host computer transmits control information to 
the enclosure services process; and (2) the RECEIVE 
DIAGNOSTIC RESULTS command by which the host 
computer solicits from the enclosure services process 
information, including state information, about the various 
components within an enclosure. 

The host computer transmits a SEND DIAGNOSTICS 
command to the enclosure services process via an enclosure 
control page. The layout for an enclosure control page is 
shown below in Table 1 . 

TABLE 1 



60 



65 



Enclosure control page 



Bits 
Bytes 



1 



0 



50 



0 PAGE CODE (02H) 

1 Reserved INFO NON- OUT UN- 

crit recov 

2 (MSB) 

PAGE LENGTH (N-3) 

3 (LSB) 
4-7 GENERATION CODE 

8-11 OVERALL CONTROL (first element type) 

12-15 ELEMENT CONTROL (first element of first element type) 

(4 bytes) ELEMENT CONTROL (last element of first element type) 

(4 bytes) OVERALL CONTROL (second element type) 

(4 bytes) ELEMENT CONTROL (first element of second element type) 

n-3 to n ELEMENT CONTROL (last element of last element type) 



55 



The enclosure control page includes an OVERALL CON- 
TROL field for each type of component within an enclosure 
and an ELEMENT CONTROL field for each discrete com- 
ponent within an enclosure. ELEMENT CONTROL fields 
for all components of a particular type are grouped together 
following the OVERALL CONTROL field for that type of 
component. These control fields have various formats 
depending on the type of component, or element. The 
formats for the control fields of the enclosure control page 
will be described below for several types of devices. The 
types of elements currently supported by the SES command 
set are shown below in Table 2 
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TABLE 2 


Type Code 


Type of element 


Type Code 


Type of element 


QOh 


Unspecified 


ODh 


Kay pad entry 








device 


Olh 


Device 


OEh 


Reserved 


02h 


Power supply 


OFh 


SCSI 








port/transceiver 


03h 


Cooling element 


10b 


Language 


04h 


Temperature sensors 


llh 


Communication port 


05h 


Door lock 


12h 


\bltage sensor 


06h 


Audible alarm 


13h 


Current sensor 


07h 


Enclosure services 


14h 


SCSI target port 




controller electronics 






08h 


SCC controller 


15h 


SCSI initiator port 




electronics 






09h 


Nonvolatile cache 


l6h 


Simple 








sub-enclosure 


OAh 


Reserved 


17-7Fh 


Reserved 


OBh 


Uninterruptible power 


80h-FFh 


Vendor-specific 




supply 




codes 


OCh 


Display 







TABLE 4 



When a host computer issues a RECEIVED DIAGNOS- 
TIC RESULTS command to the enclosure services process, 
the enclosure services process collects status information 
from each of the components, or elements, within the 
enclosure and returns an enclosure status page to the host 
computer that contains the collected status information. The 
layout of the enclosure status page is below in Table 3. 



TABLE 3 



30 



Enclosure status page 



Bits 
Bytes 



35 



8-11 
12-15 

(4 bytes) 
(4 bytes) 
(4 bytes) 



Reserved 
(MSB) 

(MSB) 



PAGE CODE (02H) 
INVOP INFO NON- CRIT UN- 
CRIT RECOV 

PAGE LENGTH (n-3) 



GENERATION CODE 



(LSB) 
(LSB) 

OVERALL STATUS (first element type) 
ELEMENT STATUS (first element of first element type) 

ELEMENT STATUS (last element of first element type) 
OVERALL STATUS (second element type) 
ELEMENT STATUS (first clement of second clement type) 



n-3 to n ELEMENT STATUS (last clement of last element type) 



50 



As with the enclosure control page, described above, the 
enclosure status page contains fields for particular 
components, or elements, grouped together following an 
overall field for that type of component. Thus, the enclosure 55 
status page contains an OVERALL STATUS field for each 
type of element followed by individual ELEMENT STATUS 
fields for each element of a particular type within the 
enclosure. The status fields vary in format depending on the 
type of element. The status field formats for several devices O o 
will be illustrated below. 

The host computer can issue a RECEIVED DIAGNOS- 
TICS RESULTS command with a special page code in order 
to solicit from the enclosure service process a configuration 
page that describes the enclosure and all the components, or 65 
elements, within the enclosure. Table 4, below, shows the 
layout of a configuration page. 



Configuration page 



Component 
name 



Bytes 



Field Name 



Enclosure 
10 descriptor 
header 



15 



Diagnostic page header 
Generation code 

8 Reserved 

9 S UB- ENCLOSURE IDENTIFIER 

10 NUMBER OF ELEMENT 
TYPES SUPPORTED CO 

11 ENCLOSURE DESCRIPTOR LENGTH (m) 
12-19 ENCLOSURE LOGICAL IDENTIFIER 

2-27 ENCLOSURE VENDOR IDENTIFICATION 
28-43 PRODUCT IDENTIFICATION 

44-47 PRODUCT REVISION LEVEL 

48 - VENDOR-SPECIFIC ENCLOSURE 

(11 + m) INFORMATION 
(4 bytes) TYPE DESCRIPTOR HEADER 

(first element type) 

(4 bytes) TYPE DESCRIPTOR HEADER 

(T" 1 element type) 
variable TYPE DESCRIPTOR TEXT (first element 

typC) 

last TYPE DESCRIPTOR TEXT 

byte - n (T™ element type) 



Enclosure 
descriptor 



Type 
descriptor 
header 
list 

Type 
descriptor 
text 



The configuration page includes an enclosure descriptor 
header and an enclosure descriptor that describes the 
enclosure, as a whole, as well as a type descriptor header list 
that includes information about each type of component, or 
element, included in the enclosure and, finally, a type 
descriptor text list that contains descriptor text correspond- 
ing to each of the element types. 

Tables 5A-B, below, show the format for an ELEMENT 
control field in the enclosure control page for a cooling 
element, such as a fan. 



TABLE 5A 



Cooling element for enclosure control pages 



Bits 



Bytes 


7 6 


5 4 3 2 1 0 


0 




COMMON CONTROL 


1-2 




Reserved 


3 


Rsrvd RQST 


RQST Reserved REQUESTED SPEED 




FAIL 


ON CODE 


TABLE 5B 




REQUESTED SPEED CODE values 




Speed Code 


Description 




000b 


Reserved 




001b 


Fan at lowest speed 




010b 


Fan at second lowest speed 




011b 


Fan at speed 3 




100b 


Fan at speed 4 




101b 


Fan at speed 5 




110b 


Fan at intermediate speed 




111b 


Fan at highest speed 



Bit fields within the ELEMENT control field allow the 
host computer to specify to the enclosure services process 
certain actions related to a particular cooling element. For 
example, by setting the RQST FAIL bit, the host computer 
specifies that a visual indicator be turned on to indicate 
failure of the cooling element. By setting the RQST ON 
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Cooling element for enclosure status pages 


Bits 




Bytes 7 


6 5 4 3 2 1 0 


0 


COMMON STATUS 


1-2 


Reserved 


3 R&rvd 


FAIL RQSTE OFF Rsrvd ACTUAL SPEED CODE 




D ON 



20 



field, host computer requests that the cooling element be 
turned on and remain on. The REQUESTED SPEED CODE 
field allows the host computer to specify a particular cooling 
fan speed at which the cooling element should operate. Table 
5B includes the different fan speed settings that can be 
specified in the requested speed code field. 

Tables 6A-B, below, show the layout for a cooling 
ELEMENT STATUS field within an enclosure status page, 
shown above in Table 3. 

TABLE 6 A 



STATUS field for a power supply element that is included in 
an enclosure status page, shown above in Table 3, is shown 
below in Table 7B. 

TABLE 7A 

Cooling element for enclosure control pages 



10 Bits 

Bytes 7 



0 COMMON CONTROL 

1-2 Reserved 

3 Rsrvd RQST RQST Reserved 

FAIL ON 



TABLE 7B 



Power supply element foi enclosure status pages 



Bits 

Bytes 7 



0 COMMON STATUS 

1 Reserved 

2 Reserved DC DC DC Rsrvd 

over- under- over- 
voltage voltage current 

3 Rsrvd FAIL RQSTED OFF OVRTMP TEMP AC DC 

ON FAIL WARN FAIL FAIL 



TABLE 6B 


ACTUAL SPEED CODE values 


Speed Code 


Description 


000b 


Fan stopped 


001b 


Fan at lowest speed 


010b 


Fan at second lowest speed 


011b 


Fan at speed 3 


100b 


Fan at speed 4 


101b 


Fan at speed 5 


110b 


Fan at intermediate speed 


111b 


Fan at highest speed 



The various bit fields within the cooling ELEMENT 
STATUS field, shown in Table 6A, indicate to the host 
computer the state of the particular cooling element, or fan. 
When the FAIL bit is set, the enclosure services process is 
indicating that the failure indication for a particular fan has 
been set on. When the RQSTED ON bit is set, the enclosure 55 
services process indicates to the host computer that the fan 
has been manually turned on or has been requested to be 
turned on via a SEND DIAGNOSTICS command. When the 
OFF bit is set, the enclosure services process indicates to the 
host computer that the fan is not operating. The enclosure 60 
services process may indicate to the host computer, via the 
ACTUAL SPEED CODE field, the actual speed of operation 
of the fan. Actual speed code values are shown above in 
Table 6B. 

A layout for the ELEMENT CONTROL field for a power 65 
supply within the enclosure control page, shown above io 
Table 1, is shown below in Table 7 A An ELEMENT 



Many of the fields in the power supply control and status 
fields are similar to those in the cooling element control and 
status fields of Tables 5A and 6A, and will not be further 
discussed. The power supply status field also includes bit 
fields to indicate under-voltage, over-voltage, over-current, 
power failure, and other temperature conditions. 

The SES command set and SES protocol specify a stan- 
dard SCSI communication between a host computer and an 
enclosure including multiple peripheral devices. The SES 
protocol allows the host computer to control operation of 
individual peripheral devices within the enclosure and also 
to acquire information about the status of operation of the 
peripheral devices 

Multi-Disk Enclosures 

The highbandwidth and flexible connectivity provided by 
the FC, along with the ability of the FC to support the SES 
command set and protocol, have made the FC an attractive 
communications medium for interconnecting host proces- 
sors with enclosures containing multiple peripheral devices 
and for interconnecting the multiple peripheral devices 
within enclosures. In the following discussions, enclosures 
will be described and represented as containing multiple 
disk drives. However, the described techniques and 
approaches for interconnecting multiple disk drives within 
an enclosure, and for interconnecting enclosures and host 
computers, are equally applicable for other types of periph- 
eral devices. 

FIG. 12 is a simplified illustration of the design used by 
manufacturers of certain currently-available FC-based 
multi-disk enclosures. The enclosure 1202 is shown in FIG. 
12 containing 8 disks drives 1204-1211. The disk drives are 
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plugged into, and interconnected by, a backplane 1212. A 
multi-component circuit board 1214 is also plugged into the 
backplane 1212. Two giga-bit interface converters 
("GBICs") 1216 and 1218 provide external fibre optic cable 
connection to the enclosure 1202. The circuit board 1214 5 
contains a processor 1220 and a number of port bypass 
circuits ("PBCs") 1222-1229 that are interconnected by an 
internal FC loop 1230. An enclosure services process runs 
on the processor 1220 to allow the host computer (not 
shown) to control various additional components within the 
enclosure, such as fans, power supplies, temperature 
sensors, etc., as discussed in the previous subsection. The 
individual disk drives 1204-1211 of the enclosure may be 
replaced, removed, or added during operation of the other 
disk drives of the enclosure. Hot-swapping is made possible 
in the currently-available systems illustrated in FIG. 12, by 15 
the port bypass circuits 1222-1229. When a disk is present 
and functioning, the FC signal passes from the FC loop 1230 
through the port bypass circuit (for example, port bypass 
circuit 1225) to the disk drive (for example, disk drive 
1207). When a disk drive is removed, the port bypass circuit 20 
instead routes the FC signal directly to the next port bypass 
circuit or other component along the FC loop 1230. For 
example, if disk drive 1207 is removed by hot-swappiog, FC 
signals will pass from disk drive 1206 through port bypass 
circuit 1224 to port bypass circuit 1225 and from port bypass 25 
circuit 1225 directly to port bypass circuit 1226. 

A single GBIC (for example, GBIC 1216) allows con- 
nection of the enclosure to a host computer via an optical 
fibre. Asecond GBIC (for example, GBIC 1218) may allow 
an enclosure to be daisy-chained to another enclosure, 30 
thereby adding another group of disk drives to the fibre 
channel loop 1230. When a second GBIC is present, and no 
further enclosures are to be daisy-chained through the sec- 
ond GBIC, a loop -back connector, or terminator, is normally 
plugged into the second GBIC to cause FC signals to loop 35 
back through the enclosure and, ultimately, back to the host 
computer. 

FIG. 13A is a schematic representation of a port bypass 
circuit, such as port bypass circuits 1222-1229 in FIG. 12. 
An input FC signal ("IN") 1302 passes through a summing 40 
amplifier 1304 to convert the differentially-encoded FC 
signal into a linear signal used within the PBC circuitry. 
Summing amplifiers 1306-1308 are similarly employed to 
interconvert linear and differential signals. The converted 
input signal 1310 is split and passed to a buffered output 45 
("Pout") 1312 and to a multiplexer 1314. Asecond FC input 
signal ("Pin") 1316 passes through summing amplifier 1307 
and is input to the multiplexer 1314. The FC output signal 
("OUT") 1318 from the multiplexer 1314 is controlled by 
the SEL control input line 1320. When the SEL control input 50 
line is asserted, the multiplexer 1314 passes the Pin input 
1316 to the output signal 1318. When the SEL control input 
fine is de- asserted, the multiplexer 1314 passes the IN input 
signal 1302 to the output signal OUT 1318. 

FIG. 13B illustrates the connection of a disk drive to a 55 
fibre channel loop via a port bypass circuit. In the interest of 
brevity, the components of the port bypass circuit in 13B that 
are the same as components shown in FIG. 13A will be 
labeled in 13B with the same labels used in FIG. 13A, and 
descriptions of these components will not be repeated. The 60 
disk drive 1322 receives an input signal IN 1302 from the 
fibre channel loop via the Port signal 1312. When the disk 
drive asserts the SEL control signal 1320, the disk drive 
provides the signal Pin 1316 that is passed by the multi- 
plexer 1314 to the output signal OUT 1318 that is transmit- 65 
ted via the FC loop to the next FC port in the direction of the 
FC signal. When the SEL control signal 1320 is de -asserted, 



the disk drive 1322 is bypassed, and the input signal IN 1302 
is passed as the output signal OUT 1318 to the next FC port 
in the direction of the FC signal. The disk drive 1322 asserts 
the SEL control signal when it is securely mounted in the 
enclosure, connected to the backplane, and functionally 
ready to inter-operate with the FC loop. When the disk drive 
1322 is absent, or not functionally ready to inter-operate 
with the FC loop, the SEL control line 1320 is de-asserted 
and the FC signal bypasses the disk drive. When the disk 
drive is hot-swapped into or out of an on-line enclosure, the 
FC loop that interconnects the functioning disk drives must 
undergo re-initialization, as discussed above, but the ensuing 
interruption is relatively slight, and any interrupted data 
transfers are recovered. However, there are different possible 
failure modes of disk drives that can degrade or disable 
operation of the FC loop and that cannot be detected and 
bypassed by the essentially passive PBC. For example, a 
disk drive may intermittently transmit spurious signals, or 
may fail to yield control of the FC loop after transmitting 
requested data. Thus, although the passive PBCs allow for 
hot-swapping of disk drives, they do not provide the high 
level of component malfunction detection and recovery 
necessary in high-availability systems. 

The Present Invention 

The method and system of the present invention are 
related to a new type of multi -peripheral-device enclosure 
that provides increased reliability, increased fault tolerance, 
and higher availability. Again, as in the previous subsection, 
this new multi-peripheral-device enclosure will be illus- 
trated and described in terms of a multi-disk enclosure. 
However, the techniques and methods of the present inven- 
tion apply generally to enclosures that may contain different 
types of peripheral devices in different combinations. The 
method and system of the present invention will be dis- 
cussed with regard to enclosures based on FC interconnec- 
tion between the host computer and the enclosure as well as 
between various peripheral devices within the enclosure. 
However, other types of communications media may be 
employed in place of the FC. Finally, the method and system 
of the present invention are discussed with regard to a 
multi-disk enclosure in which the SES command set and 
protocol provide component-level control to the host com- 
puter. However, this component-level control may be pro- 
vided by other types of protocols and command sets. 

FIG. 14 shows a highly available enclosure that incorpo- 
rates techniques related to the present invention. The highly 
available enclosure ("HAE") shown in FIG. 14 includes 8 
disk drives 1402-1409. The disk drives 1402-1409 are 
plugged into a backplane 1412 that interconnects the disk 
drives with other components in the HAE, and that also 
interconnects certain of the other components in the HAE 
independently from the disk drives. The backplane 1412 is 
passive. It contains no active components, such as process- 
ing elements, and is thus highly unlikely to become a point 
of failure within the HAE. The two link control cards 
("LCCs") 1414 and 1416 are coupled to the backplane. The 
two LCCs are essentially identical. Only the components 
included in the top LCC 1414 will be described and labeled. 
An LCC contains two GBICs 1418 and 1420, a number of 
port bypass circuits 1422-1424, and several port bypass 
circuit chips 1426 and 1428, each of which contains four 
separate port bypass circuits. The port bypass circuits and 
port bypass circuit chips are interconnected both by an FC 
loop, indicated in FIG. 14 by the single heavy line, for 
example line 1430 interconnecting port bypass circuits 1422 
and 1423, and a port bypass circuit bus 1432. In FIG. 14, 
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port bypass circuits may be shown interconnected by both a Thus, in the circuit shown in FIG. 15A, several additional 

port bypass circuit bus as well as an FC loop as, for example, levels of control are available besides the control exerted by 

the interconnection between port bypass circuits 1422 and the disk 1514 via signal line SD 1502. The PBC control 

1423. The port bypass circuit chips 1426 and 1428 fan out circuit 1506 may forcibly bypass the disk 1514 according to 

Pout, Pin, and SEL control Line signals, represented collec- 5 an internal set of rules, and a program running within the 

lively in FIG. 14 by a single line, such as line 1434, to the microprocessor 1509 can cause the disk 1514 to be forcibly 

8 disk drives 1402-1409. Each port bypass circuit chip bypassed via data transmitted to the PCB control circuit 

controls FC loop access to four disk drives. The LCC 1506. These additional levels of control allow for 

contains a processor 1436, which runs an enclosure services microprocessor-controlled bypass of individual disk drives 

process and other control programs. This processor 1436 10 following detection of disk malfunction or critical events 

includes circuitry that implements an FC port as well as signaled by environmental monitors and other such sensors, 

ports to three different internal busses. One of the internal FIG. 15B shows an example of the PBC control circuit 

busses 1438, in a preferred embodiment an I 2 C bus, implemented in hardware. A D flip-flop 1516 outputs the 

interconnects the processor 1436 with PBC controller chips forced bypass signal FB 1518. The D flip-flop changes state 

1440 and 1442 and with other components such as tempera- 35 upon receiving a strobe input signal 1520. The D flip-flop 

ture sensing devices and power monitoring devices 1444 and receives input from the SD control signal line 1522 and the 

1446. The processor on one LCC 1436 is interconnected write_data 1524 input from the microprocessor. The strobe 

with the processor on the other LCC 1448 by two separate signal is generated whenever the SD control line changes 

internal busses 1450 and 1452 that run through the back- state or whenever there is a microprocessor write operation, 

plane 1412. 20 ^ e ^ flip-flop can be set or cleared based on changes either 

The HAE is highly redundant. The disk drives 1402-1409 10 me SD j^V^ 1*12, or by changes to write data 1524 input 

are interconnected by two separate FC loops implemented, from a microprocessor. The forced bypass signal FB tracks 

in part, on the two LCC cards 1414 and 1416. Thus, if one »he SD control signal 1522, but may be overridden by 

FC loop fails, a host computer (not shown) can nonetheless microprocessor control. Thus, the control circuit of 15B, 

access and exchange data with the disk drives in the enclo- 25 when included ^ PBC control circuit 1506 in FIG. 15A, 

sure via the other FC loop. In similar fashion, if one internal allows circuit 15A to function identically to the circuit of 

bus that interconnects the two processors 1436 and 1448 FIG * 13A exce P l m ^ case that lne microprocessor elects 

fails, the two processors can communicate via the other to forcibly bypass the disk, rather than depend on the disk to 

internal bus. Although not shown in FIG. 14, the HAE bypass itself. 

includes dual power supplies and other redundant compo- 30 The enhanced PBC control circuit of FIG. 15A is also 

nents. Each of the two processors controls one of the two used in the HAE to implement various shunting operations, 

redundant components, such as one power supply, to ensure For example, PBC circuits 1422 and 1423 in FIG. 14 can be 

that a failing processor is not able to shut down both power controlled by PBC controllers 1440 and 1442 to bypass 

supplies and thus disable the HAE. The port bypass circuits, GBICs 1418 and 1420, respectively. FIGS. 16A-B illustrate 

as in the currently-available enclosures described above, 35 the usefulness of implementing a shunting operation in order 

allow for hot-swapping of disk drives. However, because the to bypass a GBIC. In FIG. 16A, two HAEs 1602 and 1604, 

port bypass circuits are themselves controlled by port bypass are schematically shown daisy-chained together via a single 

circuit controllers 1440 and 1442, additional higher-level FC loop 1606. The FC optical fibre incoming from the host 

control of the components can be achieved. For example, a computer (not shown) connects through a first GBIC 1608 to 

faulty disk drive can be identified and isolated by a software 40 the first HAE 1602. The FC loop exits the first HAE 1602 at 

routine running on the processor 1436 which can then signal GBIC 1610 and enters the second HAE 1604 at GBIC 1612. 

a port bypass circuit controller to forcibly bypass a particular Finally, the FC loop exits the second HAE 1604 at GBIC 

disk drive. Redundant environmental monitors allow for 1614 and returns to the host computer via a return path. The 

vigilant fault-tolerant monitoring of the conditions within FC circuit is looped back from GBIC 1614 using an external 

the HAE of both processors. Failure of any particular sensor 45 loop back hood 1616. 

or interconnecting internal bus will not produce a failure of There are problems associated with the simple form of 

the entire HAE. daisy -chaining illustrated in FIG. 16A. First, certain mal- 

FIG. ISA illustrates control of a port bypass circuit by a functions within the second HAE 1604 might bring down 

port bypass circuit control chip. The circuit illustrated in the entire FC loop, including the first HAE 1602. Thus, 

FIG. 15 A is similar to the circuit shown in FIG. 13B above. 50 HAEs cannot be readily isolated and bypassed when they are 

However, the control signal line, in this circuit designated daisy-chained according to the scheme of FIG. 16 A. Also, 

the "SD" control signal line 1502, does not directly control the external loop back hood 1616 is an additional component 

output of the multiplexer 1504. Instead, the SD control that adds cost to the overall system, may cause problems in 

signal line 1502 is input to a PBC control circuit 1506. This installation, and provides yet another source of single-point 

PBC control circuit may be implemented by a microproces- 55 failure. 

sor or may be implemented based on state -machine logic. The above-noted deficiencies related to the daisy- 
The PBC control circuit 1506 outputs a forced bypass chaining of FIG. 16 A can be overcome using shunt opera- 
control circuit line ("FB") that determines, as in the circuit tions controlled by PBC control logic circuits. FIG. 16B 
in 13B, whether the input signal IN 1508 is passed through shows a HAE, schematically diagramed as in FIG. 16A, with 
to the output signal OUT 1510 or whether, instead, the Pin 60 the functionality provided by the external loop back hood 
signal 1512 is passed by the multiplexer 1504 to the output 1616 of FIG. 16 A instead implemented via a PBC. In FIG. 
signal OUT 1510. The PBC control circuit 1506 can also 16B, the rightmost GBIC 1618 of HAE 1620 is controlled by 
exchange data with the microprocessor 1509 via a serial bus PBC 1622. PBC 1622 is, in turn, controlled by a PBC 
1511 or some other type of communication media. The controller 1624 which may, in turn, be controlled by the 
microprocessor 1509 can indicate to the PBC control circuit 65 microprocessor (not shown). The return FC signal 1626 is 
1506 that the PBC control circuit 1506 should assert the FC fed back into the PBC controller 1624, following 
control signal 1503 in order to bypass the disk drive 1514. conversion, as a control signal line 1628. When the GBIC 
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1618 is connected to a fibre optic cable that is, in turn, 
connected to another HAE, the FC return signal 1626 causes 
the control signal line 1628 to be asserted, and causes the 
PBC controller 1624 to control the PBC 1622 to pass FC 
signals between the HAE and an external additional HAE. 
However, when the HAE is not connected via GBIC 1618 
and a fibre optic cable to another HAE, the control signal 
line 1628 will be de-asserted, causing the PBC controller 
1624 to control the PBC 1622 to bypass the GBIC 1618 and 
thus looping the FC signal back via a return path to the host 
computer This mechanism eliminates the need for an exter- 
nal loop back hood 1616, and provides for automatic sensing 
of daisy-chained enclosures. Moreover, if an enclosure 
downstream from HAE 1620 malfunctions, the host com- 
puter (not shown) may interact with the microprocessor 
within the HAE (also not shown) to direct the PBC control- 
ler 1624 to forcibly bypass the GBIC 1618 via the PBC 
1622, thus removing downstream enclosures from the FC 
loop. Thus, defective enclosures can be isolated and 
removed via microprocessor-controlled shunting of GBICs. 

Although the present invention has been described in 
terms of a particular embodiment, it is not intended that the 
invention be limited to this embodiment. Modifications 
within the spirit of the invention will be apparent to those 
skilled in the art. For example, the present invention may be 
practiced in multi -peripheral-device enclosures that use dif- 
ferent inter and intra-enclosure communications media than 
the FC communications medium employed in the above - 
described embodiment. As another example, in number of 
different types of controllers, microprocessors, and port 
bypass circuits can be used in any number of different 
configurations to provide the three-tiered port bypass circuit 
control strategy of the present invention. Additional redun- 
dancies in controllers, microprocessors, communications 
busses, and firmware and software routines can be employed 
to further increase reliability of a multi-peripheral-device 
enclosure designed according to the method of the present 
invention. 

The foregoing description, for purposes of explanation, 
used specific nomenclature to provide a thorough under- 
standing of the invention. However, it will be apparent to 
one skilled in the art that the specific details are not required 
in order to practice the invention. In other instances, well- 
known circuits and devices are shown in block diagram form 
in order to avoid unnecessary distraction from the underly- 
ing invention. Thus, the foregoing descriptions of specific 
embodiments of the present invention are presented for 
purposes of illustration and description; they are not 
intended to be exhaustive or to limit the invention to the 
precise forms disclosed, obviously many modifications and 
variations are possible in view of the above teachings. The 
embodiments were chosen and described in order to best 
explain the principles of the invention and its practical 
applications and to thereby enable others skilled in the art to 
best utilize the invention and various embodiments with 
various modifications as are suited to the particular use 
contemplated. It is intended that the scope of the invention 
be defined by the following claims and their equivalents: 

What is claimed is: 

1. An externally controllable bypass circuit for controlling 
access by a device to a communications medium, the bypass 
circuit comprising: 

an IN input from the communications medium; 

an OUT output to the communications medium; 

a Pout output of the IN input to the device; 

a Pin input from the device; 



10 



15 



20 



25 



30 



35 



40 



45 



50 



a control signal line SD output from the device; and 
a multiplexing component that receives the IN input, the 
Pin input, and a FB control signal line that causes the 
multiplexing component to output the Pin input to the 
OUT output when the FB signal line is in a first state 
and that causes the multiplexing component to output 
the IN input to the OUT output when the FB signal line 
is in a second state. 

2. The externally controllable bypass circuit of claim 1 
wherein the device places the control signal line SD into a 
first state when the device is installed and ready to exchange 
data with the communications medium and wherein the 
control signal line has a second state when the device is not 
installed and when the device is not ready to exchange data 
with the communications medium. 

3. The externally controllable bypass circuit of claim 1 
wherein a bypass circuit controller receives the SD control 
signal line from the device and outputs the FB control signal 
line to the multiplexing component. 

4. The externally controllable bypass circuit of claim 3 
wherein the bypass circuit controller exchanges READ/ 
WRITE data with a processor. 

5. The externally controllable bypass circuit of claim 4 
wherein the bypass circuit controller is microprocessor- 
based. 

6. The externally controllable bypass circuit of claim 4 
wherein the bypass circuit controller is implemented as a 
state machine. 

7. The externally controllable bypass circuit of claim 4 
wherein the bypass circuit controller controls access of the 
device to the communications medium based on the state of 
the SD control signal line and on logic and rules incorpo- 
rated into the bypass circuit controller. 

8. The externally controllable bypass circuit of claim 4 
wherein the bypass circuit controller controls access of the 
device to the communications medium based the state of the 
SD control signal line and on data received from the 
processor. 

9. An interconnection shunt within a multiKtevice enclo- 
sure comprising: 

an inter-multi-device-enclosure communications medium 
connector that interconnects an internal communica- 
tions medium within the multi-device enclosure with an 
external communications medium; 

an externally controllable bypass circuit that controls 
access by the inter-multi-device-enclosure communi- 
cations medium connector to the external communica- 
tions medium; and 

control logic embodied within a controller that controls 
the externally controllable bypass circuit, via the inter- 
multi-device-enclosure communications medium 
connector, to connect the internal communications 
medium with the external communications medium to 
interconnect the multi-device enclosure with a host 
computer and with a number of other multi-device 
enclosures, and to disconnect the internal communica- 
tions medium from the external communications 
medium in order to isolate the multi-device enclosure 
from a host computer and from a number of other 
multi-device enclosures. 

10. The interconnection shunt of claim 9 wherein the 
internal and external communications media are both parts 
of a fibre channel arbitrated loop, wherein the interconnec- 
tion shunt controls access from an expansion inter-multi- 
device-enclosure communications medium connector to a 
downstream portion of the fibre channel arbitrated loop, and 
wherein, 
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when the controller detects signal from a downstream 
multi-device enclosure, the controller directs the inter- 
connection shunt to interconnect the multi-device 
enclosure with the downstream portion of the fibre 
channel arbitrated loop, and 5 

when the controller detects no signal from a downstream 
multi-device enclosure, the controller directs the inter- 
connection shunt to disconnect the multi-device enclo- 
sure from the downstream portion of the fibre channel 
arbitrated loop. 10 

11. The interconnection shunt of claim 9 wherein the 
internal and external communications media are both parts 
of a fibre channel arbitrated loop, wherein the interconnec- 
tion shunt controls access from a primary inter-multi -device- 
enclosure communications medium connector to an 15 
upstream portion of the fibre channel arbitrated loop, and 
wherein, 

when the controller determines that the multi-device 
enclosure should be interconnected with a host com- 
puter and other devices connected to the upstream 20 
portion of the fibre channel arbitrated loop, the con- 
troller directs the interconnection shunt to interconnect 
the multi-device enclosure with the upstream portion of 
the fibre channel arbitrated loop, and 

when the controller determines that the multi-device 
enclosure should be isolated from a host computer and 
other devices connected to the upstream portion of the 
fibre channel arbitrated loop, the controller directs the 
interconnection shunt to disconnect the multi-device 
enclosure from the upstream portion of the fibre chan- 
nel arbitrated loop. 

12. The interconnection shunt of claim 9 wherein the 
controller that controls the externally controllable bypass 
circuit is microprocessor-based. 35 

13. The interconnection shunt of claim 9 wherein the 
controller that controls the externally controllable bypass 
circuit is implemented as a state machine. 

14. The interconnection shunt of claim 9 wherein the 
controller is itself controlled by data received from a pro- 4Q 
cessor. 

15. A method for controlling access of a data exchanging 
component within a multi-peripheral-device enclosure to a 
communications medium, the method comprising: 

connecting an input from the communications medium to 
the data exchanging component; 
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connecting the input from the communications medium to 

a multiplexing component; 
connecting an output from the multiplexing component to 

the communications medium; 
connecting output from the data exchanging component to 

the multiplexing component; and 
connecting a controller to the multiplexing component via 

an FB control signal line to select output from the 

multiplexing component to the communications 

medium. 

16. The method of claim 15 wherein the data exchange 
element is a peripheral device, wherein the communications 
medium is internal within the multi-peripheral-device enclo- 
sure and interconnects peripheral devices within the multi- 
peripheral -device enclosure, wherein the controller receives 
a control signal from peripheral device via a control signal 
line, and wherein the controller sets the state of the FB 
control signal line to a first state in order to interconnect the 
peripheral device with the internal communications medium 
and sets the state of the FB control signal line to a second 
state in order to disconnect the peripheral device from the 
internal communications medium. 

17. The method of claim 15 wherein the data exchange 
element is an inter-multi-peripheral-device-enclosure 
connector, wherein the communications medium is external 
to the multi-peripheral-device enclosure and interconnects 
the multi-peripheral-device enclosure with external devices, 
and wherein the controller sets the state of the FB control 
signal line to a first state in order to interconnect the 
multi-peripheral-device enclosure with the external commu- 
nications medium and sets the state of the FB control signal 
line to a second state in order to disconnect the mulri- 
peripheral-device enclosure from the external communica- 
tions medium. 

18. The method of claim 17 wherein the inter-multi- 
peripheral-device -enclosure connector connects the multi- 
peripheral-device enclosure with a host computer. 

19. The method of claim 17 wherein the inter-multi- 
peripheral-device-enclosure connector connects the multi- 
peripheral -device enclosure with another mul ti -peripheral - 
device enclosure. 

20. The method of claim 15 wherein the communications 
medium is a fibre channel arbitrated loop. 
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[57] ABSTRACT 

The bus terminating circuit isolates itself from a bus in 
response to the magnitude of a power supply voltage 
decreasing below a predetermined threshold level. The 
bus terminating circuit includes a bus termination volt- 
age divider network having one terminal coupled 
through a threshold sensing device to one of the pair of 
power supply terminals, another terminal coupled to 
the bus and a further terminal coupled through a transis- 
tor to the other of the pair of power supply terminals. 
Another threshold sensing circuit is coupled between 
one of the pair of power supply terminals and the con- 
trol electrode of the transistor. The threshold sensing 
circuits are responsive to the magnitude of the power 
supply voltage falling below the predetermined thresh- 
old level to render devices of the threshold sensing 
circuits non-conductive and thereby electrically isolate 
the bus termination network from the bus. 

11 Claims, 3 Drawing Figures 
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or subsystems connected to the bus to be turned off 
BUS TERMINATING AND DECOUPLING without degradation in the bus operation. 

CIRCUIT . A further object of the invention is to provide a bus 

decoupling circuit which is simple, reliable and suitable 
BACKGROUND OF THE INVENTION 5 for being manufactured in monolithic integrated circuit 

Many types of modern day electronic equipment - _ ... ... 

utilize bus systems each of which includes a plurality of bus termmating circuit of one embodi- 

electrical lines used to receive and distribute informs- mcnt . u ^/coupling from a bus in response to the 

tion from a plurality of subsystems which are connected m ° f *. e P 0 "" supply voltage across the 

to the bus. More specifically, some electronic testing 10 ^ £7^ 1 ^ , 7*" n, W * ? 

systems include a controller element such as a minicom* Tf tb ^ d ,eve »; V" bus terminating circuit in- 

puter and a plurality of instruments and a display or f*~-* ^fT^ 0 " n ?^° rk - ?«decfron control 

printer which are interconnected by a general purpose * ev,cc ?f a threshold sensmg circuit The bus termina- 

Snterfece bus. The bus enables informatton to be routed „ ^J^^TJTf^ t u T 

back, and forth between the various instruments, the 13 * u P? ,y ^ mmah . "* t0 * e , bu f ™ e elect ™ ""J* 

controller and the display or printer. device has a pair of main electrodes one of which is 

EaS, imtrument tacluL aZ^nnination network eaa ^ A * ! <~don network. The threshold 

which is connected to the bus and provides quiescent ^Z^^ JJ?^ a T'™, 0 *? .° f ^ 

voltages on the bus when the bus is not in use. These ,„ l^^V^T^ ™ ^ ^ eleC } rod ? of * e 
. .. ♦ i i j *v • . j .20 electron control device. The threshold sensing circuit is 

termmation networks also reduce the magnitudes of ^ ^ ma ^ f * 

unwanted oscdlaUng s.gnals on the bus to an acceptable ^wing below the predetermined [Threshold 1 level to 

n • ' .* * i • i j j- . render the electron control device non-conductive and 

Prior art termination networks include a discrete ^ M ^ ^ ion Qf ^ bus terminadoil 

voltage divider circuit having one resistor connected M netWQrk frQm ^ fcus 
from the bus to the positive power supply terminal and 
. another resistor connected from the bus to ground. The BRIEF DESCRIPTION OF THE DRAWINGS 
electrical power provided to the voltage divider is de- mG x shows dor m redstive termination network 
rived directly from the instrument itself. The foregoing connected to a bus linC( a line driver md a line 
discrete resistive termination network typically pro- 30 FIG 2 h a schematic diagram of a bus termination 
wdes a quiescent direct current voltage on the bus of ^ decoupling circuit of one embodiment of the inven- 
approximately 3 to 3.5 volts. ^ md 

For some tests for instance, it may be desirable to FIG. 3 is a graph of a desired relationship between 
utilize ess^than i all of the instruments connected to a ^ bus voltage ^ bus current faci utated by the bus 
particular bus. When some of the instruments connected 35 termination circuit of FIG. 2. 
to the bus are turned off, the resistors of the termination 

networks thereof provide a degrading efFect on the bus DETAILED DESCRIPTION OF THE 

because such resistors tend to pull the quiescent and PREFERRED EMBODIMENT 

signal voltage magnitudes on the bus to a lower level. FIG. 1 is a partial block and schematic drawing of 
As the number of instruments that are turned off in- 40 part 0 f an instrument or other electronic device 10 hav- 
creases the degrading effect becomes increasingly fog a logic portion 12, a line driver 14, and a line re- 
worse because the loading caused by the termination ce i V er 16. Terminal or node 18 is connected to both the 
networks increases. Consequently, it has been necessary output terminal 20 of line driver 14 and the input termi- 
m the past for at least one-half of the instruments or nal 22 of receiver 16. Output terminal 24 of receiver 16 
other subsystems connected to a given bus to remain 45 connected to logic block 12 and input terminal 26 of 
operative whether they are being utilized or not so as to driver 14 is connected to logic block 12. 
not undesirably load down the bus. Consequently, such Th e prior art bus termination network includes a 
subsystems are oftentimes powered on when they are discrete resistor 28, which is connected between power 
not needed thereby decreasing the life of. such subsys- supply tenninal 30 of instrument 10 and node 32. Dis- 
tems and causing a waste of electrical power. More- 50 crete resistor 34 which is connected between node 32 
over, when only the minim u m number of instruments and ground or reference terminal 36 is also included in 
are powered on, the degrading effect of the subsystems the termination network. Node 32 is connected through 
connected to the line which are powered off may in terminal 38 to bus 40. Resistors 28 and 34 form a voltage 
some instances degrade the magnitude of logical "Ts" divider. Generally, each bus line 40 is connected to a 
to the extent that they may be interpreted as logical 55 plurality of instruments and hence to a plurality of 
"0V thereby causing erroneous information to be nodes corresponding to node 32. If the power for instru- 
passed through the bus. ment 10 is on, for instance, the voltage divider including 

SUMMARY OF THE INVENTION resistors 28 and 34 tends to bias node 32 and hence bus 

line 40 at a predetermined quiescent voltage magnitude. 

Accordingly, one object of the present invention is to 60 When power for instrument 10 is turned off, however, 
provide a bus terminating and decoupling circuit which the magnitude of the voltage on terminal 30 falls to 
essentially disconnects or electrically isolates an electri- zero. Consequently, resistors 32 and 34 then tend to 
cal system or subsystem from a bus in response to such load bus 40. As other instruments, connected to bus 40 
system or subsystem being turned off so that the bus are also turned off, the resistances of the resistors of the 
continues to operate as if that system or subsystem was 65 termination networks thereof corresponding to resistor 
not connected thereto. 32 and 34 tend to combine in parallel with the resistance 

Another object of the invention is to provide a bus of resistors 32 and 34 thereby increasing the load on bus 
termination circuit which allows any number of systems 40 and decreasing the magnitude of the quiescent and 
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signal voltages thereof. Thus, there is a definite maxi- Referring now to FIG. 2, when a voltage of sufficient 
mum limit on how many "off" instruments or other magnitude is applied to terminal 52 of circuit 44, current 
"off* systems can be connected to bus 40 and still allow flows through resistor 66 and forward biased diodes 68, 
bus 40 to function. 70 and 72 to the base of transistor 64. This current 
Monolithic circuit 44 of FIG. 2 has been developed to 5 causes transistor 64 to turn on and saturate. As a result, 
overcome the loading problems associated with the current then flows through diode 56, resistors 58 and 60, 
termination network of FIG. 1, which includes resistors diode 62 and the collector-to-emitter path of transistor 
28 and 34. Bus terminating and decoupling circuit 44 . 64. Since diodes 56, 62 are forward biased and transistor 
includes an input terminal 46 which can be coupled to a 64 is saturated, resistors 58 and 60 provide the desired 
line driver and receiver, and to a node 48, which can be 10 termination characteristic 100 of curve 98 of FIG. 3, 
coupled to a bus 50. Circuit 44 further includes two essentially as though only resistors 58 and 60 were con- 
substantially parallel circuit paths extending between nected to bus 50. 

positive power supply terminal 52 and ground or refer- If instrument 10 is turned off, the voltage on terminal 

ence terminal 54. One of these paths includes diode 56 52 falls to zero volts. As the power supply voltage mag- 

which is connected in series with resistor 58 between « nitude becomes less than the predetermined level of 

supply terminal 52 and node 48. Resistor 60, diode 62 about 2.5 volts, for instance, as.estabhshed by the anode- 

and the collector-to-emitter or main path of NPN tran- toncathode junctions of threshold setting diodes 68 70 

sistor 64 are connected in series between node 48 and ™ d 72 and * e base-to-emitter junction of transistor 64, 

ground terminal 54. Resistors 58 and 60 provide the cu ? ent °° Xon & r p * h mclud T g 

desired bus termination network. 20 resist ° r <*Jf du *« * 70 ™ d 72 * Consequently, 

The other series path of bus terminating and decou- ™E*f* J? J * * ^.^f 11 ^ at 

pling circuit 44 includes resistor 66 which is connected * e ca *°* ^ d, °? e 62 ' Since n f ° c ^ ni ^ bIe /° 2° W 

in series with threshold determining diodes 68, 70, 72 to ^ rou ^ diode 6^ no current is also able to flow 

. , ^ . . , , , ~ ' i' _ through resistor 60. Thus, resistor 60 appears to be 

the base or control electrode of transistor or electron „ * A , - . i * j * j . 

... rjl „ .... . . . . . 25 disconnected or is isolated from node 48 in response to 

control device 64. Resistor 74 is connected between the u ■ , , j n 

. t » j c * ■ * j ^ m ♦ • i *a transistor 64 being rendered non-conductive. Thus, 

base electrode of transistor 64 and ^ound terminal 54. ^ f „ ides * nQ loadin ^ ^ whcn b 

FIG. 3 shows the relationship between the bus volt- rcmoycd ^ tcrminal $2 ^ oreovcrf „ ^power 

age 9 V BU5 , which is plotted along abscissa axis 78 and { w{ Qn termina] „ ^ Wow 

the bus current, which is plotted along ordinate ^ dctcrmincd lcvcl of about 3-0 voltS( for instancc> threfh . 

axis 80 for charactenzmg the desired normal operation M ^ diode 56 back . biased ^ n0 cur . 

of circuit 44. Triis characteristic is defined by a plurality fcnt can flow thcrcthrongh . Consequendy, resistor 58 

of points plotted on the plane defined by axes 78 and 80 appears t0 ^ discoimected or ^ted from node 48. 

More particularly, it is desirable that the magnitude of since n0 current nowg through ehhcr rcsistor 58 or #), 

the voltage on bus 50 be at least 2.5 volts if zero current 35 then node ^ presents a ^ impe dance to bus 50. Thus, 

is flowing therein as defined by point 81. Further, it is circuit 44 does not , oad bus 50 whcn thc system or 

desired that the maximum voltage on bus 50 be no more subsystem including circuit 44 is turned off or the sup- 

than 3.7 volts with zero current flowing as defined by pJy voltage magnitude falls below a predetermined 

point 82. If the voltage on bus 50 is forced to a value of threshold of 2.5 volts, which is the lower of the two 

0.4 volt then it is desired that the minimum current 40 thresholds 

flowing in bus line 50 be - 1.3 milliamps as defined by Diode « compensates for the temperature character- 
point 84 and that the maximum current be -3.2 milli- G f diode 56 at node 48 so that the voltage at node 
amps as defined by point 86. If a current more negative 4$ rem ains substantially independent of temperature 
than - 12 millivolts is applied to bus 50 then it is desired variation. For example, during normal operation as the 
that the bus voltage be clamped to less than - 1 .5 volts. 45 ambient temperature increases, the voltage drop across 
Thus, the voltage is less than - 1.5 volts at - 12 milli- diodc ^ decreases which tends to cause thc voltage at 
amps as indicated by point 88. This clamping action is node 48 to increase. However, the voltage drop across 
performed by a diode in the input of the line receiver. If & also tends to decrease as the ambient temperar 
the voltage on bus 50 is forced to 5 volts, it is desired t ure increases which tends to lower the voltage at termi- 
that that current be greater than 0.7 of a milliamp as 50 na l 48. Thus, the voltage across diode 62 changes in an 
indicated by point 90. Also, it was desired that if a volt- equal but opposite direction from the voltage change 
age of 5.5 volts is provided on bus 50 that no more than across diode 56 thereby enabling the bus voltage to not 
2.5 milliamps flow, as indicated by point 92. change because of diode 56. The saturation voltage 
Thus, the foregoing seven points define the voltage between the main or collector and emitter electrodes of 
and current characteristics that are facilitated on bus 50 55 transistor 64 remains substantially constant over the 
under normal operation of circuit 44. The shaded areas desired temperature range. 

of FIG. 3 indicate forbidden regions for the voltage-to- Resistors 58 and 60 can have respective values of 
current characteristics and the unshaded regions indi- 1800 ohms and 3600 ohms. Resistor 66 limits the magni- 
cate desired areas. Curve 98 indicates one nominal volt- tudc of the current which flows into the base of transis- 
age and current characteristic provided to bus line 50 60 tor 64 during the normal "on" condition thereof. Resis- 
under normal operation. Although curve 98 is a typical tor 74 provides a current pulldown for the base transis- 
characteristic, it is to be kept in mind that it is only tor 64 to maintain transistor 64 in an "off' condition 
required that the characteristic remain within the non- when no current is flowing through the threshold sens- 
shaded area of FIG. 3. Generally, the voltage divider ing circuit including diodes 68, 70 and 72. Conse- 
network including resistors 48 and 60 provide the 65 quently, transistor 64 is maintained "offT when there is 
sloped portion 100 above bend 102 of curve 98* A diode zero voltage on supply terminal 52. Resistor 66 can 
to ground in the input of the line receiver provides the have a resistance of approximately 10 kilohms and resis- 
clamping indicated by portion 104 and bend 102. tor 74 can have a resistance of approximately 20 ki- 
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lphms. Resistor 74 bleeds off current which may leak 
across the emitter-to-base junction of transistor 64 while 
transistor 64 is non-conductive. 

What has been described, therefore, is a bus terminat- 
ing and decoupling circuit which essentially discon- 5 
hects or electrically isolates an electrical system or 
subsystem from bus 50 in response to such system or 
subsystem being turned off so that bus 50 continues to 
operate as if that system or subsystem was not con- 
nected thereto. More specifically, diode 56 turns off as 10 
the magnitude of supply voltage, VCC, falls below a 
certain predetermined level thereby isolating resistor 58 
from bus 50. Thus, diode 56 performs a threshold sens- 
ing function. Moreover, as the supply voltage VCC, 
falls below another predetermined magnitude, diodes 
68, 70, 72 become no longer forward biased and transis- 
tor 64 then becomes no longer conductive. Thus, these 
devices perform another threshold sensing function. 
When transistor 64 is non-conductive then resistor 60 is ^ 
also electrically isolated from bus 50. Thus, circuit 44 
allows any number of systems or subsystems, each of 
which include circuit 44 connected to bus 50, to be 
turned off without degradation in the bus operation. 
Decoupling circuit 44 is simple, reliable and suitable for 25 
being manufactured in monolithic integrated circuit 
form. 

I claim: 

1. A bus terminating circuit which is self-decoupling 
from a bus in response to the magnitude of a power 30 
supply voltage across a pair of power supply terminals 
decreasing below a predetermined threshold level, in- 
cluding in combination: 

bus termination network means having one terminal 
coupled to one of the pair of power supply termi- 35 
nals, another terminal coupled to the bus and a 
further terminal; 

electron control means having a pair of main elec- 
trodes and a control electrode, one of said main 
electrodes being coupled to said bus. termination 40 
network, the other of said main electrodes being 
coupled to the other of said pair of power supply 
terminals; and 

first threshold sensing means coupled between one of 
the pair of power supply terminals and said control 45 
electrode of said electron control means, said first 
threshold sensing means including a plurality of 
semiconductor junctions, said first threshold sens- 
ing means being responsive to the magnitude of the 5Q 
power supply voltage falling below the predeter- 
mined threshold level to render said electron con- 
trol means non-conductive to thereby electrically 
isolate at least a portion of said bus termination 
network means from the bus. 55 

2. The bus terminating circuit of claim 1 wherein said 
main electrodes of said electron control means are cou- 
pled in scries with said further electrode of said bus 
termination network means. 

3. The bus terminating circuit of claim 1 further in- 50 
eluding second threshold sensing means coupled be- 
tween one of the pair of power supply terminals and . 
said bus termination network means, said second thresh- 
old sensing means electrically isolating any portions of 
said bus termination network means from the bus that 65 
can not be isolated by said first threshold sensing means 

in response to the magnitude of the power supply volt- 
age falling below a predetermined magnitude. 
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4. The bus terminating circuit of claim 3 wherein said 
second threshold sensing means includes at least one 
semiconductor diode. 

5. The bus terminating circuit of claim 4 further in- 
cluding another semiconductor diode for temperature 
compensating said semiconductor diode of said second 
threshold sensing means. 

6. A bus terminating circuit which is self-decoupling 
from a bus in response to the magnitude of the power 
supply voltage across a pair of power supply terminals 
decreasing below a predetermined threshold level, said 
bus terminating circuit including in combination: 

a bus termination network including a first resistive 
means connected between one terminal and an- 
other terminal and a second resistive means con- 
nected between said another terminal and a further 
terminal, said another terminal being coupled to 
the bus; 

first circuit means coupling said one terminal of said 
bus termination network means to one of said 
power supply terminals; 

transistor means having a pair of main electrodes and 
a control electrode; 

second circuit means coupling one of said main elec- 
trodes of said transistor means to said further termi- 
nal of said bus termination network means; 

said second of said main electrodes of said transistor 
means being coupled to said other terminal of said 
pair of power supply terminals; and 

first threshold sensing means including a plurality of 
semiconductor diodes being coupled between said 
one of said pair of power supply terminals and said 
control electrode of said transistor means, said first 
threshold sensing means being responsive to the 
magnitude of the power supply voltage falling 
below the predetermined threshold level to render 
said transistor means non-conductive and thereby 
electrically isolate said second resistive means of 
said bus termination network means from the bus. 

7. The bus terminating circuit of claim 6 wherein said 
first circuit means includes a second threshold sensing 
means coupled between said one terminal of said bus 
termination network and said one of the pair of power 
supply terminals, said second threshold sensing means 
including a semiconductor diode. 

8. The bus terminating circuit of claim 7 wherein said 
second circuit means includes a further diode means to 
temperature compensate said semiconductor diode of 
said second threshold sensing circuit. 

9. A bus terminating circuit which is self-decoupling 
from a bus in response to the magnitude of a power 
supply voltage across a pair of power supply terminals 
decreasing below a predetermined threshold level, in- 
cluding in combination: 

bus termination network means having one terminal 
coupled to one of the pair of power supply termi- 
nals, another terminal coupled to the bus and a 
further terminal; 

electron control means having a pair of main elec- 
trodes and a control electrode, one of said main 
electrodes being coupled to said bus termination 
network, the other of said main electrodes being 
coupled to the other of said pair of power supply 
terminals; 

first threshold sensing means coupled between one of 
the pair of power supply terminals and said control 
electrode of said electron control means, said first 
threshold sensing means being responsive to the 
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magnitude of the power supply voltage falling 
below the predetermined threshold level to render 
said electron control means non-conductive to 
thereby electrically isolate at least a portion of said 
bus termination network means from the bus; and 
second threshold sensing means coupled between one 
of the pair of power supply terminals and said bus 
termination network means, said second threshold 
sensing means electrically isolating any portions of 
said bus termination network means from the bus 
that can not be isolated by said first threshold sens- 
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ing means in response to the magnitude of . the 
power supply . voltage falling below a predeter- 
mined magnitude. 

10. The bus terminating circuit of claim 9 wherein 
said second threshold sensing means includes at least 
one semiconductor diode. 

11. The bus terminating circuit of claim 10 further 
including another semiconductor diode for temperature 
compensating said semiconductor diode of said second 
threshold sensing means. 
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ABSTRACT 



The interface circuit serves for connecting two apparatus by 
way of a bidirectional bus which comprises a data lead for 
transmitting data and a cycle lead for transmitting a cycle 
signal. The interface circuit consists of a circuit arrangement 
provided at each apparatus, which comprises a separating 
means for separating the data signal on the data lead and the 
cylce signal on the cycle lead in each case into a transmitting 
and a receiving branch, and which furthermore comprises in 
each case for the data lead and the cylce lead a bus driver 
having a differential transmitter and receiver. The data 
signals and cylce signals between the apparatus are trans- 
mitted via differential leads. 

3 Claims, 1 Drawing Sheet 
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INTERFACE FOR AN I 2 C BUS bus, before reaching the transmitter/receiver component and 

the transmission leads to the distanced apparatus, in each 

BACKGROUND OF THE INVENTION case are separated into a transmitting branch and a receiving 

The invention relates to an interface circuit for connecting branch and that, via a differential transmitter/receiver 
a first apparatus to at least one second apparatus distant 5 component, the signals arc transmitted between the appara- 

thereto by way of a bi-directional bus, in particular an f*C ™ differential collection leads, 

bus which comprises a data lead for the bi-directional At the differential transmission leads there are thus 

transmission of data and a cycle lead for the bi-directional present identical signals which are, however, opposite in 

transmission of a cycle signal 10 their polarity so that, based on a difference formation 

Such an interface circuit is known from EP 0 759 593 A2. between the signals, potential data errors are eliminated The 

The known interface circuit serves for transmitting the data transmitter/receiver components are terminated with char- 

of an apparatus controlled via an I 2 C bus to a computer and acteristic impedance of the transmission leads in a manner 

reverse via a so-called RS232 interface. The data transfer is J5 free of reflection, by which means longer connection leads 

made by way of three control leads, wherein the one lead of several meters to a few kilometers may also be used, 

frees the other lead in its logic condition "0" and blocks it The separation in each case into a transmitting and 

in its logic condition "1". In this manner data may be receiving branch is advantageously carried out by two 

transmitted from the computer to the controlled apparatus in Opto-couplers which are decoupled from one another via 

"bits" and the controlled apparatus may be cycled. 20 fast diodes and which at the same time also achieve a 

Generally with the I 2 C bus, which consists of two leads galvanic separation of the apparatuses communicating with 

SDA and SCL transmitting data and cycle signals in both one another. 

directions, no error recognition mechanisms with respect to These Opto-couplers are thus connected between the 

hardware are present. The recognition, and where appropri- 25 apparatus to which the interface is allocated and the differ- 

ate alleviation, of transmission errors may only be realized ential bus driver. After the Opto-coupler, the now occurring 

through software (cf. the publication of "The V'C bus" of signal is inputted to the differential bus driver (i.e. the 

Ludwig Brackmann in ELRAD 1991, booklet 5, pages transmitter/receiver component). The receiver of the differ- 

44—47). The mentioned publication also specifies that the ential bus driver is switched such that it always monitors the 

I^C bus serves as the communication link between the 30 signals on the ^C bus. The transmitter, however, is by way 

integrated circuits of a circuit board or between several of logic circuitry only activated when a '0* is transmitted, 

circuit boards of an apparatus. In this application the I 2 C of course, provided with the interface circuit according to 

offers advantages with respect to the small surface area the invention, not only two but more than two apparatuses 

occupied on the circuit board, low operative costs and high 35 may communicate with one another. Each apparatus must 

reliability. have tne same interface (circuit arrangement). The multi- 

With medical applications there is often the requirement master capability and the transmission frequency of the I 2 C 

to exchange data or control commands between apparatuses remain intact, 
distanced from one another. This is, for example, the case 

with a TEM insufflation system (TEM-transanal endoscopic « BRIEF DESCRITO ON SEVERAL VIEWS OF 

microsurgery) subdivided into two apparatuses. The known 

apparatuses in the application must be connected to one The invention is described in more detail by way of a 

another and be able to mutually receive and transmit infer- block diagram (FIG. 1) of a preferred embodiment of the 

mation. With these types of medical applications it is 45 interface circuit according to the invention, 

extraordinarily important that all data and control commands The interface circuit represented in FIG. 1 relates to the 

are transmitted in an undisturbed and genuine manner. Since external connection of two apparatuses A and B by way of 

the apparatuses are to be as small and as inexpensive as an I 2 C bus. The manner of functioning, the construction and 

possible, there is therefore no opportunity for software the protocol of the I^C bus are assumed to be known (cf. e.g. 

solutions for the recognition or alleviation of transmission 50 the previously mentioned technical article "The I 2 C bus" by 

errors. Such transmission errors may not only occur by Ludwig Brackmann). 

electric coupling in the leads from the outside but also by The interface circuit comprises a circuit arrangement 

potential differences between the apparatuses. Security allocated to each apparatus. The represented circuit arrange- 

against malfunctioning implemented through software, if it 55 men t is allocated to a first apparatus A symbolically repre- 

could successfully be carried out at all, would have too great sented on the left side of FIG. 1. The interface circuit, via 

of an expense. data lead SDA, receives data from the first apparatus A and 

BDTcc cTumADv nc tut: tma/ttmttoxt transmits data to the second apparatus B. In a similar manner 

BRIEF SUMMARY OF THE I^^vTNTION 4 , . 4 , . r . , 

the circuit arrangement receives data from the distanced 

Against this setting of the problem, it is the object of the 60 apparatus B and sends this data to the first apparatus A The 

invention to so form the interaction of apparatuses which are interface circuit also receives/transmits cycle signals from/to 

controlled by an I^C bus and which are distanced from one the first apparatus A via the cycle lead SCL. 

another, such that in a physical way malfunctioning of the The represented interface circuit is incorporated into a 

data exchange is ruled out. fi5 TEM insulation system. The first apparatus A is a Laparo- 

According to the invention such a solution is effected in Pneu and the second apparatus is a TEM pump. With TEM 

that the data signal SDA and the cycle signal SCL of the I 2 C it is specifically necessary to unfold the rectum with C0 2 gas 
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and, when required, to rinse it. The TEM pump and the lively. The signal lines SDA+, SDA- and SCL+, SCL- are 

Laparo-Pneu of this application must be connected to one connected with resistors Rl, R2 and R3, R4 respectively, 

another and be able to mutually receive and transmit infor- whose values are the respective characteristic impedances, 

mation. With this application it is particularly important that and also to the ends of the differential bus leads lying at the 

the data to be transferred is transmitted in as undisturbed and 5 interface. The resistances Rl and R4 determine the level of 

genuine a manner as possible. Since, as already mentioned, SDA+, SDA- and SCL+, SCL- respectively, while the 

the I 2 C bus in itself does not provide any error recognition transmitter is deactivated. 

mechanism with regard to hardware, the interface circuit [ n me receiving branches E no inversion is necessary nor 

according to the invention provides physical (i.e. circuit) ^ desired, s j nce indeed the signal arriving at the receiving 

means which are able to practically exclude disturbances in point should ^ rcad unc hanged, (i.e. not inverted), 

the data exchange occurring on the transmission path. Thc apparatus B C0Dtains m exactly identical 

Hie interface circuit for each apparatus A, B comprises interface circuit arrangement as that described herein for the 

identical circuit arrangements, of which that belonging to apparatus A 

apparatus A is shown in FIG. 1. For the data lead SDA and is The above details show mat ^ mterface ^ cuii according 
the cycle lead SCL there is provided a separating means to the mveation 5 te suita51e for m error-free transmission 
consisting of Opto-couplers la, lb, 2a, 2b, which separate of da(a Qr CQntrol signals between danced apparatuses of 
the data and cycle signals of the 1 C bus in each case into a micro . surgery . ]n particular the mterface circuit according to 
transmitting branch S and a receiving branch E. The Opto- ^ tfac invention fc suitable for ^ apparatuses of a TEM 
couplers la, lb and 2a, 2b used for this separation simul- msuffla Uon system, which are separated from one another, 
taneously carry out a galvanic separation between the first since ^ apparatuses separat ed from one another are gal- 
apparatus A and the second apparatus B. By way of this vanically separat ed and the transmission between the appa- 
measure, possible disturbances because of diverting currents rahJses may bc cffcctcd in a crror . free manner by thc 
or differences in potential are eliminated. 25 different bus driver components and the data signal leads 
The Opto-couplers lb, 2b of the receiving branches E arc SDA+) SDA „ ^ cycle signal leads SCL+, SCL- which are 
only active when the Opto-coupler la and 2a is inactive (i.e., connected to the bus-driver components. The transmission 
SDA is not sending a "0" to the differential transmitter)and frequency as well as the known protocols for the data 
a "0" is received by the differential receiver and input to the ^ cxcnaage via ^ ? C bus remain intact. 
Opto-coupler lb, 2b in the corresponding receiving branch What is claimed is: 

E. It must also be prevented that the respective Opto-coupler i. An interface circuit for connecting a first apparatus to 

lb, 2b in the receiving branches E does not simultaneously a t least one second apparatus distant therefrom by way of a 

couple back a transmitted "0" at the SDA input to the bi-directional bus, in particular an I 2 C bus, the interface 

apparatus A, since otherwise a self -blocking would arise. 35 circuit having a data lead for the bi-directional transmission 

The Opto-couplers la, 1/? and 2a, 26 of the transmitting and 0 f a data signal and a cycle lead for the bi-directional 

receiving branches S and E are decoupled from one another transmission of a cycle signal, wherein the interface circuit 

by fast diodes, which, however, are not shown in the circuit consists of a circuit arrangement provided at each apparatus, 

diagram of the FIG. 1. The data signals SDA from/to the the circuit arrangement comprising a separating means for 

Opto-couplers la, lb (i.e. the data signals SDA allocated to separating the data signal at the data lead and the cycle 

the transmitting and receiving branches S, E), as well as the signal at the cycle lead in each case into a transmitting 

cycle signals SCL from/to the Opto-couplers 2a, 2b (i.e. the branch and a receiving branch, wherein the separating means 

cycle signals SCL allocated to the transmitting and receiving f or the data lead and the cycle lead in each case comprises 

branch S, E), are in each case applied separately to two 45 ^ Opto-coupler for the transmitting branch and the receiv- 

differential bus drivers 4, 6 comprising transmitters 4a, 6a ing branch for the galvanic separation of each transmitting 

and receivers 4b, 6b. branch and each receiving branch, and a bus driver having 

Each receiver 4b and 62? of the differential bus drivers 4, a differential transmitter and a differential receiver provided 

6 always monitors the signals on the I 2 C bus. The transmit- in each case for the data lead and the cycle lead, wherein 

ters 4a and 6a are however only actively switched by way 50 data signals and cycle signals between the apparatuses are 

of a release logic la and 8a respectively when a "0" is transmitted via differential leads. 

transmitted from SDA, (i.e. the transmitters 4a and 6a, 2. An interface circuit for connecting a first apparatus to 

during transmission, are respectively switched on and off). at least one second apparatus distant therefrom by way of a 

For this, the signal SDA and the cycle signal SCL in the 55 bi-directional bus, in particular an I^C bus, the interface 

transmitting branches S are led from the Opto-coupler via a circuit having a data lead for the bi-directional transmission 

respective inverting member 3 and 5, respectively, to the of a data signal and a cycle lead for the bi-directional 

release logic la and 8a, respectively, of the differential bus transmission of a cycle signal, wherein the interface circuit 

driver component 4 and 6 respectively. This means that the consists of a circuit arrangement provided at each apparatus, 

inverting members 3 and 5 merely ensure that the bus driver 60 the circuit arrangement comprising a separating means for 

components 4 and 6 respectively are started or stopped. The separating the data signal at the data lead and the cycle 

respective data entrances D of the transmitters 4a, 6a are signal at the cycle lead in each case into a transmitting 

always kept fixed at ground. branch and a receiving branch, and a bus driver having a 

The differential bus driver components 4, 6 convert the 65 differential transmitter and a differential receiver provided in 

I^C bus signals SDA and SCL into physical differential each case for the data lead and the cycle lead, wherein data 

signal levels SDA+, SDA- and SCL+ and SCL- respec- signals and cycle signals between the apparatuses are trans- 
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mitted via differential leads, wherein an Opto-coupler in 
each case of the transmitting branch and the receiving 
branch of the separating means are decoupled by diodes 
such that the receiving branch may only be active when a 
"1" has been transmitted or not transmitted, but a "0" has s 
been received. 

3. An interface circuit for connecting a first apparatus to 
at least one second apparatus distant therefrom by way of a 
bi-directional bus, in particular an 1 2 C bus, the interface 10 
circuit having a data lead for the bi-directional transmission 
of a data signal and a cycle lead for the bi-directional 
transmission of a cycle signal, wherein the interface circuit 
consists of a circuit arrangement provided at each apparatus, 
the circuit arrangement comprising a separating means for 15 
separating the data signal at the data lead and the cycle 
signal at the cycle lead in each case into a transmitting 



branch and a receiving branch, wherein the separating means 
for the data lead and the cycle lead in each case comprises 
an Opto-coupler for the transmitting branch and the receiv- 
ing branch for the galvanic separation of each transmitting 
branch and each receiving branch, and a bus driver having 
a differential transmitter and a differential receiver provided 
in each case for the data lead and the cycle lead, wherein 
data signals and cycle signals between the apparatuses are 
transmitted via differential leads, wherein the Opto-coupler 
in each case of the transmitting branch and the receiving 
branch of the separating means are decoupled by diodes 
such that the receiving branch may only be active when a 
"1" has been transmitted or not transmitted, but a "(T has 
been received. 
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